00:00:00.001 Started by upstream project "autotest-nightly" build number 3630 00:00:00.001 originally caused by: 00:00:00.002 Started by upstream project "nightly-trigger" build number 3012 00:00:00.002 originally caused by: 00:00:00.002 Started by timer 00:00:00.133 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.134 The recommended git tool is: git 00:00:00.134 using credential 00000000-0000-0000-0000-000000000002 00:00:00.136 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.180 Fetching changes from the remote Git repository 00:00:00.183 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.221 Using shallow fetch with depth 1 00:00:00.221 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.221 > git --version # timeout=10 00:00:00.252 > git --version # 'git version 2.39.2' 00:00:00.252 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.253 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.253 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.040 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.050 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.061 Checking out Revision 6201031def5bfb7f90a861bc162998684798607e (FETCH_HEAD) 00:00:05.061 > git config core.sparsecheckout # timeout=10 00:00:05.070 > git read-tree -mu HEAD # timeout=10 00:00:05.086 > git checkout -f 6201031def5bfb7f90a861bc162998684798607e # timeout=5 00:00:05.104 Commit message: "scripts/kid: Add issue 3354" 00:00:05.104 > git rev-list --no-walk 6201031def5bfb7f90a861bc162998684798607e # timeout=10 00:00:05.202 [Pipeline] Start of Pipeline 00:00:05.214 [Pipeline] library 00:00:05.216 Loading library shm_lib@master 00:00:05.216 Library shm_lib@master is cached. Copying from home. 00:00:05.234 [Pipeline] node 00:00:05.274 Running on WFP37 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:05.276 [Pipeline] { 00:00:05.287 [Pipeline] catchError 00:00:05.288 [Pipeline] { 00:00:05.308 [Pipeline] wrap 00:00:05.318 [Pipeline] { 00:00:05.325 [Pipeline] stage 00:00:05.328 [Pipeline] { (Prologue) 00:00:05.504 [Pipeline] sh 00:00:06.254 + logger -p user.info -t JENKINS-CI 00:00:06.274 [Pipeline] echo 00:00:06.276 Node: WFP37 00:00:06.283 [Pipeline] sh 00:00:06.612 [Pipeline] setCustomBuildProperty 00:00:06.625 [Pipeline] echo 00:00:06.626 Cleanup processes 00:00:06.632 [Pipeline] sh 00:00:06.918 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:06.918 9236 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:06.932 [Pipeline] sh 00:00:07.216 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.216 ++ grep -v 'sudo pgrep' 00:00:07.216 ++ awk '{print $1}' 00:00:07.216 + sudo kill -9 00:00:07.216 + true 00:00:07.232 [Pipeline] cleanWs 00:00:07.241 [WS-CLEANUP] Deleting project workspace... 00:00:07.242 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.255 [WS-CLEANUP] done 00:00:07.260 [Pipeline] setCustomBuildProperty 00:00:07.277 [Pipeline] sh 00:00:07.567 + sudo git config --global --replace-all safe.directory '*' 00:00:07.633 [Pipeline] nodesByLabel 00:00:07.635 Found a total of 1 nodes with the 'sorcerer' label 00:00:07.645 [Pipeline] httpRequest 00:00:07.930 HttpMethod: GET 00:00:07.931 URL: http://10.211.164.96/packages/jbp_6201031def5bfb7f90a861bc162998684798607e.tar.gz 00:00:08.719 Sending request to url: http://10.211.164.96/packages/jbp_6201031def5bfb7f90a861bc162998684798607e.tar.gz 00:00:08.975 Response Code: HTTP/1.1 200 OK 00:00:09.048 Success: Status code 200 is in the accepted range: 200,404 00:00:09.049 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_6201031def5bfb7f90a861bc162998684798607e.tar.gz 00:00:10.015 [Pipeline] sh 00:00:10.307 + tar --no-same-owner -xf jbp_6201031def5bfb7f90a861bc162998684798607e.tar.gz 00:00:10.325 [Pipeline] httpRequest 00:00:10.330 HttpMethod: GET 00:00:10.331 URL: http://10.211.164.96/packages/spdk_06472fb6d0c234046253a9989fef790e0cbb219e.tar.gz 00:00:10.332 Sending request to url: http://10.211.164.96/packages/spdk_06472fb6d0c234046253a9989fef790e0cbb219e.tar.gz 00:00:10.354 Response Code: HTTP/1.1 200 OK 00:00:10.355 Success: Status code 200 is in the accepted range: 200,404 00:00:10.356 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_06472fb6d0c234046253a9989fef790e0cbb219e.tar.gz 00:01:24.232 [Pipeline] sh 00:01:24.528 + tar --no-same-owner -xf spdk_06472fb6d0c234046253a9989fef790e0cbb219e.tar.gz 00:01:27.084 [Pipeline] sh 00:01:27.373 + git -C spdk log --oneline -n5 00:01:27.373 06472fb6d lib/idxd: fix batch size in kernel IDXD 00:01:27.373 44dcf4fb9 pkgdep/idxd: Add dependency for accel-config used in kernel IDXD 00:01:27.373 3dbaa93c1 nvmf: pass command dword 12 and 13 for write 00:01:27.373 19327fc3a bdev/nvme: use dtype/dspec for write commands 00:01:27.373 c11e5c113 bdev: introduce bdev_nvme_cdw12 and cdw13, and add them to ext_opts 00:01:27.385 [Pipeline] } 00:01:27.405 [Pipeline] // stage 00:01:27.415 [Pipeline] stage 00:01:27.417 [Pipeline] { (Prepare) 00:01:27.437 [Pipeline] writeFile 00:01:27.455 [Pipeline] sh 00:01:27.741 + logger -p user.info -t JENKINS-CI 00:01:27.753 [Pipeline] sh 00:01:28.038 + logger -p user.info -t JENKINS-CI 00:01:28.049 [Pipeline] sh 00:01:28.335 + cat autorun-spdk.conf 00:01:28.336 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:28.336 SPDK_TEST_NVMF=1 00:01:28.336 SPDK_TEST_NVME_CLI=1 00:01:28.336 SPDK_TEST_NVMF_NICS=mlx5 00:01:28.336 SPDK_RUN_UBSAN=1 00:01:28.336 NET_TYPE=phy 00:01:28.344 RUN_NIGHTLY=1 00:01:28.348 [Pipeline] readFile 00:01:28.392 [Pipeline] withEnv 00:01:28.395 [Pipeline] { 00:01:28.408 [Pipeline] sh 00:01:28.696 + set -ex 00:01:28.696 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:01:28.696 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:01:28.696 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:28.696 ++ SPDK_TEST_NVMF=1 00:01:28.696 ++ SPDK_TEST_NVME_CLI=1 00:01:28.696 ++ SPDK_TEST_NVMF_NICS=mlx5 00:01:28.696 ++ SPDK_RUN_UBSAN=1 00:01:28.696 ++ NET_TYPE=phy 00:01:28.696 ++ RUN_NIGHTLY=1 00:01:28.696 + case $SPDK_TEST_NVMF_NICS in 00:01:28.696 + DRIVERS=mlx5_ib 00:01:28.696 + [[ -n mlx5_ib ]] 00:01:28.696 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:28.696 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:35.280 rmmod: ERROR: Module irdma is not currently loaded 00:01:35.280 rmmod: ERROR: Module i40iw is not currently loaded 00:01:35.280 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:35.280 + true 00:01:35.280 + for D in $DRIVERS 00:01:35.280 + sudo modprobe mlx5_ib 00:01:35.280 + exit 0 00:01:35.291 [Pipeline] } 00:01:35.309 [Pipeline] // withEnv 00:01:35.315 [Pipeline] } 00:01:35.331 [Pipeline] // stage 00:01:35.342 [Pipeline] catchError 00:01:35.344 [Pipeline] { 00:01:35.360 [Pipeline] timeout 00:01:35.360 Timeout set to expire in 40 min 00:01:35.362 [Pipeline] { 00:01:35.377 [Pipeline] stage 00:01:35.380 [Pipeline] { (Tests) 00:01:35.396 [Pipeline] sh 00:01:35.685 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:01:35.685 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:01:35.685 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:01:35.685 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:01:35.685 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:35.685 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:01:35.685 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:01:35.685 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:01:35.685 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:01:35.685 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:01:35.685 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:01:35.685 + source /etc/os-release 00:01:35.685 ++ NAME='Fedora Linux' 00:01:35.685 ++ VERSION='38 (Cloud Edition)' 00:01:35.685 ++ ID=fedora 00:01:35.685 ++ VERSION_ID=38 00:01:35.685 ++ VERSION_CODENAME= 00:01:35.685 ++ PLATFORM_ID=platform:f38 00:01:35.685 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:35.685 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:35.685 ++ LOGO=fedora-logo-icon 00:01:35.685 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:35.685 ++ HOME_URL=https://fedoraproject.org/ 00:01:35.685 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:35.685 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:35.685 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:35.685 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:35.685 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:35.685 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:35.685 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:35.685 ++ SUPPORT_END=2024-05-14 00:01:35.685 ++ VARIANT='Cloud Edition' 00:01:35.685 ++ VARIANT_ID=cloud 00:01:35.685 + uname -a 00:01:35.685 Linux spdk-wfp-37 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:35.685 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:01:38.229 Hugepages 00:01:38.229 node hugesize free / total 00:01:38.229 node0 1048576kB 0 / 0 00:01:38.229 node0 2048kB 0 / 0 00:01:38.229 node1 1048576kB 0 / 0 00:01:38.229 node1 2048kB 0 / 0 00:01:38.229 00:01:38.229 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:38.229 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:01:38.229 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:01:38.229 NVMe 0000:d8:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:38.229 + rm -f /tmp/spdk-ld-path 00:01:38.229 + source autorun-spdk.conf 00:01:38.229 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:38.229 ++ SPDK_TEST_NVMF=1 00:01:38.229 ++ SPDK_TEST_NVME_CLI=1 00:01:38.229 ++ SPDK_TEST_NVMF_NICS=mlx5 00:01:38.229 ++ SPDK_RUN_UBSAN=1 00:01:38.229 ++ NET_TYPE=phy 00:01:38.229 ++ RUN_NIGHTLY=1 00:01:38.229 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:38.229 + [[ -n '' ]] 00:01:38.229 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:38.229 + for M in /var/spdk/build-*-manifest.txt 00:01:38.229 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:38.229 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:01:38.229 + for M in /var/spdk/build-*-manifest.txt 00:01:38.229 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:38.229 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:01:38.229 ++ uname 00:01:38.229 + [[ Linux == \L\i\n\u\x ]] 00:01:38.229 + sudo dmesg -T 00:01:38.229 + sudo dmesg --clear 00:01:38.229 + dmesg_pid=10167 00:01:38.229 + [[ Fedora Linux == FreeBSD ]] 00:01:38.229 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:38.230 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:38.230 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:38.230 + sudo dmesg -Tw 00:01:38.230 + [[ -x /usr/src/fio-static/fio ]] 00:01:38.230 + export FIO_BIN=/usr/src/fio-static/fio 00:01:38.230 + FIO_BIN=/usr/src/fio-static/fio 00:01:38.230 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:38.230 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:38.230 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:38.230 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:38.230 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:38.230 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:38.230 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:38.230 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:38.230 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:01:38.230 Test configuration: 00:01:38.230 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:38.230 SPDK_TEST_NVMF=1 00:01:38.230 SPDK_TEST_NVME_CLI=1 00:01:38.230 SPDK_TEST_NVMF_NICS=mlx5 00:01:38.230 SPDK_RUN_UBSAN=1 00:01:38.230 NET_TYPE=phy 00:01:38.491 RUN_NIGHTLY=1 00:35:45 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:01:38.491 00:35:45 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:38.491 00:35:45 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:38.491 00:35:45 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:38.491 00:35:45 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:38.491 00:35:45 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:38.491 00:35:45 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:38.491 00:35:45 -- paths/export.sh@5 -- $ export PATH 00:01:38.491 00:35:45 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:38.491 00:35:45 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:01:38.491 00:35:45 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:38.491 00:35:45 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714084545.XXXXXX 00:01:38.491 00:35:45 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714084545.Lz2n6N 00:01:38.491 00:35:45 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:38.491 00:35:45 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:38.491 00:35:45 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:01:38.491 00:35:45 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:38.491 00:35:45 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:38.491 00:35:45 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:38.491 00:35:45 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:01:38.491 00:35:45 -- common/autotest_common.sh@10 -- $ set +x 00:01:38.491 00:35:45 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:38.491 00:35:45 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:01:38.491 00:35:45 -- pm/common@17 -- $ local monitor 00:01:38.491 00:35:45 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:38.491 00:35:45 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=10201 00:01:38.491 00:35:45 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:38.491 00:35:45 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=10203 00:01:38.491 00:35:45 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:38.491 00:35:45 -- pm/common@21 -- $ date +%s 00:01:38.491 00:35:45 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=10205 00:01:38.491 00:35:45 -- pm/common@21 -- $ date +%s 00:01:38.491 00:35:45 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:38.491 00:35:45 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=10209 00:01:38.491 00:35:45 -- pm/common@26 -- $ sleep 1 00:01:38.491 00:35:45 -- pm/common@21 -- $ date +%s 00:01:38.491 00:35:45 -- pm/common@21 -- $ date +%s 00:01:38.492 00:35:45 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714084545 00:01:38.492 00:35:45 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714084545 00:01:38.492 00:35:45 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714084545 00:01:38.492 00:35:45 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714084545 00:01:38.492 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714084545_collect-vmstat.pm.log 00:01:38.492 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714084545_collect-bmc-pm.bmc.pm.log 00:01:38.492 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714084545_collect-cpu-load.pm.log 00:01:38.492 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714084545_collect-cpu-temp.pm.log 00:01:39.432 00:35:46 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:01:39.432 00:35:46 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:39.432 00:35:46 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:39.432 00:35:46 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:01:39.432 00:35:46 -- spdk/autobuild.sh@16 -- $ date -u 00:01:39.432 Thu Apr 25 10:35:46 PM UTC 2024 00:01:39.432 00:35:46 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:39.432 v24.05-pre-448-g06472fb6d 00:01:39.432 00:35:46 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:39.432 00:35:46 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:39.432 00:35:46 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:39.432 00:35:46 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:39.432 00:35:46 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:39.433 00:35:46 -- common/autotest_common.sh@10 -- $ set +x 00:01:39.693 ************************************ 00:01:39.693 START TEST ubsan 00:01:39.693 ************************************ 00:01:39.693 00:35:46 -- common/autotest_common.sh@1111 -- $ echo 'using ubsan' 00:01:39.693 using ubsan 00:01:39.693 00:01:39.693 real 0m0.001s 00:01:39.693 user 0m0.000s 00:01:39.693 sys 0m0.000s 00:01:39.693 00:35:46 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:01:39.693 00:35:46 -- common/autotest_common.sh@10 -- $ set +x 00:01:39.693 ************************************ 00:01:39.693 END TEST ubsan 00:01:39.693 ************************************ 00:01:39.693 00:35:46 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:39.693 00:35:46 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:39.693 00:35:46 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:39.693 00:35:46 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:39.693 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:01:39.693 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:41.074 Using 'verbs' RDMA provider 00:01:56.558 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:02:06.550 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:02:06.550 Creating mk/config.mk...done. 00:02:06.550 Creating mk/cc.flags.mk...done. 00:02:06.550 Type 'make' to build. 00:02:06.550 00:36:13 -- spdk/autobuild.sh@69 -- $ run_test make make -j112 00:02:06.550 00:36:13 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:06.550 00:36:13 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:06.550 00:36:13 -- common/autotest_common.sh@10 -- $ set +x 00:02:06.810 ************************************ 00:02:06.810 START TEST make 00:02:06.810 ************************************ 00:02:06.810 00:36:13 -- common/autotest_common.sh@1111 -- $ make -j112 00:02:07.070 make[1]: Nothing to be done for 'all'. 00:02:15.208 The Meson build system 00:02:15.208 Version: 1.3.1 00:02:15.208 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:02:15.208 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:02:15.208 Build type: native build 00:02:15.208 Program cat found: YES (/usr/bin/cat) 00:02:15.208 Project name: DPDK 00:02:15.208 Project version: 23.11.0 00:02:15.208 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:02:15.208 C linker for the host machine: cc ld.bfd 2.39-16 00:02:15.208 Host machine cpu family: x86_64 00:02:15.208 Host machine cpu: x86_64 00:02:15.208 Message: ## Building in Developer Mode ## 00:02:15.208 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:15.208 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:02:15.208 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:15.208 Program python3 found: YES (/usr/bin/python3) 00:02:15.208 Program cat found: YES (/usr/bin/cat) 00:02:15.208 Compiler for C supports arguments -march=native: YES 00:02:15.208 Checking for size of "void *" : 8 00:02:15.208 Checking for size of "void *" : 8 (cached) 00:02:15.208 Library m found: YES 00:02:15.208 Library numa found: YES 00:02:15.208 Has header "numaif.h" : YES 00:02:15.208 Library fdt found: NO 00:02:15.208 Library execinfo found: NO 00:02:15.208 Has header "execinfo.h" : YES 00:02:15.208 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:02:15.208 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:15.208 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:15.208 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:15.208 Run-time dependency openssl found: YES 3.0.9 00:02:15.208 Run-time dependency libpcap found: YES 1.10.4 00:02:15.208 Has header "pcap.h" with dependency libpcap: YES 00:02:15.208 Compiler for C supports arguments -Wcast-qual: YES 00:02:15.208 Compiler for C supports arguments -Wdeprecated: YES 00:02:15.208 Compiler for C supports arguments -Wformat: YES 00:02:15.208 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:15.208 Compiler for C supports arguments -Wformat-security: NO 00:02:15.208 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:15.208 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:15.208 Compiler for C supports arguments -Wnested-externs: YES 00:02:15.208 Compiler for C supports arguments -Wold-style-definition: YES 00:02:15.208 Compiler for C supports arguments -Wpointer-arith: YES 00:02:15.208 Compiler for C supports arguments -Wsign-compare: YES 00:02:15.208 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:15.208 Compiler for C supports arguments -Wundef: YES 00:02:15.208 Compiler for C supports arguments -Wwrite-strings: YES 00:02:15.208 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:15.208 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:15.208 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:15.208 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:15.208 Program objdump found: YES (/usr/bin/objdump) 00:02:15.208 Compiler for C supports arguments -mavx512f: YES 00:02:15.208 Checking if "AVX512 checking" compiles: YES 00:02:15.208 Fetching value of define "__SSE4_2__" : 1 00:02:15.208 Fetching value of define "__AES__" : 1 00:02:15.208 Fetching value of define "__AVX__" : 1 00:02:15.208 Fetching value of define "__AVX2__" : 1 00:02:15.208 Fetching value of define "__AVX512BW__" : 1 00:02:15.208 Fetching value of define "__AVX512CD__" : 1 00:02:15.208 Fetching value of define "__AVX512DQ__" : 1 00:02:15.208 Fetching value of define "__AVX512F__" : 1 00:02:15.208 Fetching value of define "__AVX512VL__" : 1 00:02:15.208 Fetching value of define "__PCLMUL__" : 1 00:02:15.208 Fetching value of define "__RDRND__" : 1 00:02:15.208 Fetching value of define "__RDSEED__" : 1 00:02:15.208 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:15.208 Fetching value of define "__znver1__" : (undefined) 00:02:15.208 Fetching value of define "__znver2__" : (undefined) 00:02:15.208 Fetching value of define "__znver3__" : (undefined) 00:02:15.208 Fetching value of define "__znver4__" : (undefined) 00:02:15.208 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:15.208 Message: lib/log: Defining dependency "log" 00:02:15.208 Message: lib/kvargs: Defining dependency "kvargs" 00:02:15.208 Message: lib/telemetry: Defining dependency "telemetry" 00:02:15.208 Checking for function "getentropy" : NO 00:02:15.208 Message: lib/eal: Defining dependency "eal" 00:02:15.208 Message: lib/ring: Defining dependency "ring" 00:02:15.208 Message: lib/rcu: Defining dependency "rcu" 00:02:15.208 Message: lib/mempool: Defining dependency "mempool" 00:02:15.208 Message: lib/mbuf: Defining dependency "mbuf" 00:02:15.208 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:15.208 Fetching value of define "__AVX512F__" : 1 (cached) 00:02:15.208 Fetching value of define "__AVX512BW__" : 1 (cached) 00:02:15.208 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:02:15.208 Fetching value of define "__AVX512VL__" : 1 (cached) 00:02:15.208 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:02:15.208 Compiler for C supports arguments -mpclmul: YES 00:02:15.208 Compiler for C supports arguments -maes: YES 00:02:15.208 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:15.208 Compiler for C supports arguments -mavx512bw: YES 00:02:15.208 Compiler for C supports arguments -mavx512dq: YES 00:02:15.208 Compiler for C supports arguments -mavx512vl: YES 00:02:15.208 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:15.208 Compiler for C supports arguments -mavx2: YES 00:02:15.208 Compiler for C supports arguments -mavx: YES 00:02:15.208 Message: lib/net: Defining dependency "net" 00:02:15.208 Message: lib/meter: Defining dependency "meter" 00:02:15.208 Message: lib/ethdev: Defining dependency "ethdev" 00:02:15.208 Message: lib/pci: Defining dependency "pci" 00:02:15.208 Message: lib/cmdline: Defining dependency "cmdline" 00:02:15.208 Message: lib/hash: Defining dependency "hash" 00:02:15.208 Message: lib/timer: Defining dependency "timer" 00:02:15.208 Message: lib/compressdev: Defining dependency "compressdev" 00:02:15.208 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:15.208 Message: lib/dmadev: Defining dependency "dmadev" 00:02:15.208 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:15.208 Message: lib/power: Defining dependency "power" 00:02:15.208 Message: lib/reorder: Defining dependency "reorder" 00:02:15.208 Message: lib/security: Defining dependency "security" 00:02:15.208 Has header "linux/userfaultfd.h" : YES 00:02:15.208 Has header "linux/vduse.h" : YES 00:02:15.208 Message: lib/vhost: Defining dependency "vhost" 00:02:15.208 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:15.208 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:15.208 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:15.208 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:15.208 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:15.208 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:15.208 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:15.208 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:15.208 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:15.208 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:15.208 Program doxygen found: YES (/usr/bin/doxygen) 00:02:15.208 Configuring doxy-api-html.conf using configuration 00:02:15.208 Configuring doxy-api-man.conf using configuration 00:02:15.208 Program mandb found: YES (/usr/bin/mandb) 00:02:15.208 Program sphinx-build found: NO 00:02:15.208 Configuring rte_build_config.h using configuration 00:02:15.208 Message: 00:02:15.208 ================= 00:02:15.208 Applications Enabled 00:02:15.208 ================= 00:02:15.208 00:02:15.208 apps: 00:02:15.208 00:02:15.208 00:02:15.208 Message: 00:02:15.208 ================= 00:02:15.208 Libraries Enabled 00:02:15.208 ================= 00:02:15.208 00:02:15.208 libs: 00:02:15.208 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:15.208 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:15.208 cryptodev, dmadev, power, reorder, security, vhost, 00:02:15.208 00:02:15.208 Message: 00:02:15.208 =============== 00:02:15.208 Drivers Enabled 00:02:15.208 =============== 00:02:15.208 00:02:15.208 common: 00:02:15.208 00:02:15.208 bus: 00:02:15.208 pci, vdev, 00:02:15.208 mempool: 00:02:15.208 ring, 00:02:15.208 dma: 00:02:15.208 00:02:15.208 net: 00:02:15.208 00:02:15.208 crypto: 00:02:15.208 00:02:15.209 compress: 00:02:15.209 00:02:15.209 vdpa: 00:02:15.209 00:02:15.209 00:02:15.209 Message: 00:02:15.209 ================= 00:02:15.209 Content Skipped 00:02:15.209 ================= 00:02:15.209 00:02:15.209 apps: 00:02:15.209 dumpcap: explicitly disabled via build config 00:02:15.209 graph: explicitly disabled via build config 00:02:15.209 pdump: explicitly disabled via build config 00:02:15.209 proc-info: explicitly disabled via build config 00:02:15.209 test-acl: explicitly disabled via build config 00:02:15.209 test-bbdev: explicitly disabled via build config 00:02:15.209 test-cmdline: explicitly disabled via build config 00:02:15.209 test-compress-perf: explicitly disabled via build config 00:02:15.209 test-crypto-perf: explicitly disabled via build config 00:02:15.209 test-dma-perf: explicitly disabled via build config 00:02:15.209 test-eventdev: explicitly disabled via build config 00:02:15.209 test-fib: explicitly disabled via build config 00:02:15.209 test-flow-perf: explicitly disabled via build config 00:02:15.209 test-gpudev: explicitly disabled via build config 00:02:15.209 test-mldev: explicitly disabled via build config 00:02:15.209 test-pipeline: explicitly disabled via build config 00:02:15.209 test-pmd: explicitly disabled via build config 00:02:15.209 test-regex: explicitly disabled via build config 00:02:15.209 test-sad: explicitly disabled via build config 00:02:15.209 test-security-perf: explicitly disabled via build config 00:02:15.209 00:02:15.209 libs: 00:02:15.209 metrics: explicitly disabled via build config 00:02:15.209 acl: explicitly disabled via build config 00:02:15.209 bbdev: explicitly disabled via build config 00:02:15.209 bitratestats: explicitly disabled via build config 00:02:15.209 bpf: explicitly disabled via build config 00:02:15.209 cfgfile: explicitly disabled via build config 00:02:15.209 distributor: explicitly disabled via build config 00:02:15.209 efd: explicitly disabled via build config 00:02:15.209 eventdev: explicitly disabled via build config 00:02:15.209 dispatcher: explicitly disabled via build config 00:02:15.209 gpudev: explicitly disabled via build config 00:02:15.209 gro: explicitly disabled via build config 00:02:15.209 gso: explicitly disabled via build config 00:02:15.209 ip_frag: explicitly disabled via build config 00:02:15.209 jobstats: explicitly disabled via build config 00:02:15.209 latencystats: explicitly disabled via build config 00:02:15.209 lpm: explicitly disabled via build config 00:02:15.209 member: explicitly disabled via build config 00:02:15.209 pcapng: explicitly disabled via build config 00:02:15.209 rawdev: explicitly disabled via build config 00:02:15.209 regexdev: explicitly disabled via build config 00:02:15.209 mldev: explicitly disabled via build config 00:02:15.209 rib: explicitly disabled via build config 00:02:15.209 sched: explicitly disabled via build config 00:02:15.209 stack: explicitly disabled via build config 00:02:15.209 ipsec: explicitly disabled via build config 00:02:15.209 pdcp: explicitly disabled via build config 00:02:15.209 fib: explicitly disabled via build config 00:02:15.209 port: explicitly disabled via build config 00:02:15.209 pdump: explicitly disabled via build config 00:02:15.209 table: explicitly disabled via build config 00:02:15.209 pipeline: explicitly disabled via build config 00:02:15.209 graph: explicitly disabled via build config 00:02:15.209 node: explicitly disabled via build config 00:02:15.209 00:02:15.209 drivers: 00:02:15.209 common/cpt: not in enabled drivers build config 00:02:15.209 common/dpaax: not in enabled drivers build config 00:02:15.209 common/iavf: not in enabled drivers build config 00:02:15.209 common/idpf: not in enabled drivers build config 00:02:15.209 common/mvep: not in enabled drivers build config 00:02:15.209 common/octeontx: not in enabled drivers build config 00:02:15.209 bus/auxiliary: not in enabled drivers build config 00:02:15.209 bus/cdx: not in enabled drivers build config 00:02:15.209 bus/dpaa: not in enabled drivers build config 00:02:15.209 bus/fslmc: not in enabled drivers build config 00:02:15.209 bus/ifpga: not in enabled drivers build config 00:02:15.209 bus/platform: not in enabled drivers build config 00:02:15.209 bus/vmbus: not in enabled drivers build config 00:02:15.209 common/cnxk: not in enabled drivers build config 00:02:15.209 common/mlx5: not in enabled drivers build config 00:02:15.209 common/nfp: not in enabled drivers build config 00:02:15.209 common/qat: not in enabled drivers build config 00:02:15.209 common/sfc_efx: not in enabled drivers build config 00:02:15.209 mempool/bucket: not in enabled drivers build config 00:02:15.209 mempool/cnxk: not in enabled drivers build config 00:02:15.209 mempool/dpaa: not in enabled drivers build config 00:02:15.209 mempool/dpaa2: not in enabled drivers build config 00:02:15.209 mempool/octeontx: not in enabled drivers build config 00:02:15.209 mempool/stack: not in enabled drivers build config 00:02:15.209 dma/cnxk: not in enabled drivers build config 00:02:15.209 dma/dpaa: not in enabled drivers build config 00:02:15.209 dma/dpaa2: not in enabled drivers build config 00:02:15.209 dma/hisilicon: not in enabled drivers build config 00:02:15.209 dma/idxd: not in enabled drivers build config 00:02:15.209 dma/ioat: not in enabled drivers build config 00:02:15.209 dma/skeleton: not in enabled drivers build config 00:02:15.209 net/af_packet: not in enabled drivers build config 00:02:15.209 net/af_xdp: not in enabled drivers build config 00:02:15.209 net/ark: not in enabled drivers build config 00:02:15.209 net/atlantic: not in enabled drivers build config 00:02:15.209 net/avp: not in enabled drivers build config 00:02:15.209 net/axgbe: not in enabled drivers build config 00:02:15.209 net/bnx2x: not in enabled drivers build config 00:02:15.209 net/bnxt: not in enabled drivers build config 00:02:15.209 net/bonding: not in enabled drivers build config 00:02:15.209 net/cnxk: not in enabled drivers build config 00:02:15.209 net/cpfl: not in enabled drivers build config 00:02:15.209 net/cxgbe: not in enabled drivers build config 00:02:15.209 net/dpaa: not in enabled drivers build config 00:02:15.209 net/dpaa2: not in enabled drivers build config 00:02:15.209 net/e1000: not in enabled drivers build config 00:02:15.209 net/ena: not in enabled drivers build config 00:02:15.209 net/enetc: not in enabled drivers build config 00:02:15.209 net/enetfec: not in enabled drivers build config 00:02:15.209 net/enic: not in enabled drivers build config 00:02:15.209 net/failsafe: not in enabled drivers build config 00:02:15.209 net/fm10k: not in enabled drivers build config 00:02:15.209 net/gve: not in enabled drivers build config 00:02:15.209 net/hinic: not in enabled drivers build config 00:02:15.209 net/hns3: not in enabled drivers build config 00:02:15.209 net/i40e: not in enabled drivers build config 00:02:15.209 net/iavf: not in enabled drivers build config 00:02:15.209 net/ice: not in enabled drivers build config 00:02:15.209 net/idpf: not in enabled drivers build config 00:02:15.209 net/igc: not in enabled drivers build config 00:02:15.209 net/ionic: not in enabled drivers build config 00:02:15.209 net/ipn3ke: not in enabled drivers build config 00:02:15.209 net/ixgbe: not in enabled drivers build config 00:02:15.209 net/mana: not in enabled drivers build config 00:02:15.209 net/memif: not in enabled drivers build config 00:02:15.209 net/mlx4: not in enabled drivers build config 00:02:15.209 net/mlx5: not in enabled drivers build config 00:02:15.209 net/mvneta: not in enabled drivers build config 00:02:15.209 net/mvpp2: not in enabled drivers build config 00:02:15.209 net/netvsc: not in enabled drivers build config 00:02:15.209 net/nfb: not in enabled drivers build config 00:02:15.209 net/nfp: not in enabled drivers build config 00:02:15.209 net/ngbe: not in enabled drivers build config 00:02:15.209 net/null: not in enabled drivers build config 00:02:15.209 net/octeontx: not in enabled drivers build config 00:02:15.209 net/octeon_ep: not in enabled drivers build config 00:02:15.209 net/pcap: not in enabled drivers build config 00:02:15.209 net/pfe: not in enabled drivers build config 00:02:15.209 net/qede: not in enabled drivers build config 00:02:15.209 net/ring: not in enabled drivers build config 00:02:15.209 net/sfc: not in enabled drivers build config 00:02:15.209 net/softnic: not in enabled drivers build config 00:02:15.209 net/tap: not in enabled drivers build config 00:02:15.209 net/thunderx: not in enabled drivers build config 00:02:15.209 net/txgbe: not in enabled drivers build config 00:02:15.209 net/vdev_netvsc: not in enabled drivers build config 00:02:15.209 net/vhost: not in enabled drivers build config 00:02:15.209 net/virtio: not in enabled drivers build config 00:02:15.209 net/vmxnet3: not in enabled drivers build config 00:02:15.209 raw/*: missing internal dependency, "rawdev" 00:02:15.209 crypto/armv8: not in enabled drivers build config 00:02:15.209 crypto/bcmfs: not in enabled drivers build config 00:02:15.209 crypto/caam_jr: not in enabled drivers build config 00:02:15.209 crypto/ccp: not in enabled drivers build config 00:02:15.209 crypto/cnxk: not in enabled drivers build config 00:02:15.209 crypto/dpaa_sec: not in enabled drivers build config 00:02:15.209 crypto/dpaa2_sec: not in enabled drivers build config 00:02:15.209 crypto/ipsec_mb: not in enabled drivers build config 00:02:15.209 crypto/mlx5: not in enabled drivers build config 00:02:15.209 crypto/mvsam: not in enabled drivers build config 00:02:15.209 crypto/nitrox: not in enabled drivers build config 00:02:15.209 crypto/null: not in enabled drivers build config 00:02:15.209 crypto/octeontx: not in enabled drivers build config 00:02:15.209 crypto/openssl: not in enabled drivers build config 00:02:15.209 crypto/scheduler: not in enabled drivers build config 00:02:15.209 crypto/uadk: not in enabled drivers build config 00:02:15.209 crypto/virtio: not in enabled drivers build config 00:02:15.209 compress/isal: not in enabled drivers build config 00:02:15.209 compress/mlx5: not in enabled drivers build config 00:02:15.209 compress/octeontx: not in enabled drivers build config 00:02:15.209 compress/zlib: not in enabled drivers build config 00:02:15.209 regex/*: missing internal dependency, "regexdev" 00:02:15.209 ml/*: missing internal dependency, "mldev" 00:02:15.209 vdpa/ifc: not in enabled drivers build config 00:02:15.209 vdpa/mlx5: not in enabled drivers build config 00:02:15.209 vdpa/nfp: not in enabled drivers build config 00:02:15.209 vdpa/sfc: not in enabled drivers build config 00:02:15.209 event/*: missing internal dependency, "eventdev" 00:02:15.209 baseband/*: missing internal dependency, "bbdev" 00:02:15.209 gpu/*: missing internal dependency, "gpudev" 00:02:15.209 00:02:15.209 00:02:15.209 Build targets in project: 85 00:02:15.209 00:02:15.209 DPDK 23.11.0 00:02:15.209 00:02:15.210 User defined options 00:02:15.210 buildtype : debug 00:02:15.210 default_library : shared 00:02:15.210 libdir : lib 00:02:15.210 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:02:15.210 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:02:15.210 c_link_args : 00:02:15.210 cpu_instruction_set: native 00:02:15.210 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:02:15.210 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:02:15.210 enable_docs : false 00:02:15.210 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:15.210 enable_kmods : false 00:02:15.210 tests : false 00:02:15.210 00:02:15.210 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:15.210 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:02:15.210 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:15.210 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:15.210 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:15.210 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:15.210 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:15.210 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:15.210 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:15.210 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:15.210 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:15.210 [10/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:15.210 [11/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:15.210 [12/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:15.210 [13/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:15.210 [14/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:15.210 [15/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:15.210 [16/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:15.210 [17/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:15.210 [18/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:15.210 [19/265] Linking static target lib/librte_kvargs.a 00:02:15.210 [20/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:15.210 [21/265] Linking static target lib/librte_log.a 00:02:15.210 [22/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:15.210 [23/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:15.210 [24/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:15.210 [25/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:15.210 [26/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:15.210 [27/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:15.210 [28/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:15.210 [29/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:15.210 [30/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:15.210 [31/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:15.476 [32/265] Linking static target lib/librte_pci.a 00:02:15.476 [33/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:15.476 [34/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:15.476 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:15.476 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:15.476 [37/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:15.476 [38/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:15.476 [39/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:15.476 [40/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:15.476 [41/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:15.476 [42/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:15.476 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:15.476 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:15.476 [45/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:15.476 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:15.476 [47/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:15.476 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:15.476 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:15.477 [50/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:15.740 [51/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:15.740 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:15.740 [53/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:15.740 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:15.740 [55/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:15.740 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:15.740 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:15.740 [58/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.740 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:15.740 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:15.740 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:15.740 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:15.740 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:15.740 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:15.740 [65/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:15.740 [66/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:15.740 [67/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:15.740 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:15.740 [69/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:15.740 [70/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:15.740 [71/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:15.740 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:15.740 [73/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:15.740 [74/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:15.740 [75/265] Linking static target lib/librte_meter.a 00:02:15.740 [76/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:15.740 [77/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:15.740 [78/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:15.740 [79/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:15.740 [80/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:15.740 [81/265] Linking static target lib/librte_ring.a 00:02:15.740 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:15.740 [83/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:15.740 [84/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:15.740 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:15.740 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:15.740 [87/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.740 [88/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:15.740 [89/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:15.740 [90/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:15.740 [91/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:15.740 [92/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:15.740 [93/265] Linking static target lib/librte_telemetry.a 00:02:15.740 [94/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:15.740 [95/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:15.740 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:15.740 [97/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:15.740 [98/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:15.740 [99/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:15.740 [100/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:15.740 [101/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:15.740 [102/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:15.740 [103/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:15.740 [104/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:15.740 [105/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:15.740 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:15.740 [107/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:15.740 [108/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:15.740 [109/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:15.740 [110/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:15.740 [111/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:15.740 [112/265] Linking static target lib/librte_timer.a 00:02:15.740 [113/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:15.740 [114/265] Linking static target lib/librte_rcu.a 00:02:15.740 [115/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:15.740 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:15.740 [117/265] Linking static target lib/librte_mempool.a 00:02:15.740 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:15.740 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:15.740 [120/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:15.740 [121/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:15.740 [122/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:15.740 [123/265] Linking static target lib/librte_cmdline.a 00:02:15.740 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:15.740 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:15.740 [126/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:15.740 [127/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:15.740 [128/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:15.740 [129/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:15.740 [130/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:15.740 [131/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:15.740 [132/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:15.740 [133/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:15.740 [134/265] Linking static target lib/librte_dmadev.a 00:02:15.740 [135/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:15.740 [136/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:15.740 [137/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:15.740 [138/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:15.740 [139/265] Linking static target lib/librte_compressdev.a 00:02:15.740 [140/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:15.740 [141/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:15.740 [142/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:15.740 [143/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:15.740 [144/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:15.740 [145/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:15.740 [146/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:15.740 [147/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:15.740 [148/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:15.740 [149/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:15.740 [150/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.740 [151/265] Linking static target lib/librte_eal.a 00:02:15.740 [152/265] Linking static target lib/librte_net.a 00:02:15.740 [153/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:15.740 [154/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:15.999 [155/265] Linking static target lib/librte_power.a 00:02:15.999 [156/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:15.999 [157/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:15.999 [158/265] Linking target lib/librte_log.so.24.0 00:02:15.999 [159/265] Linking static target lib/librte_mbuf.a 00:02:15.999 [160/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:15.999 [161/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.999 [162/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.999 [163/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:15.999 [164/265] Linking static target lib/librte_reorder.a 00:02:15.999 [165/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:15.999 [166/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:15.999 [167/265] Linking static target lib/librte_security.a 00:02:15.999 [168/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:15.999 [169/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:15.999 [170/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:15.999 [171/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:15.999 [172/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:15.999 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:15.999 [174/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:15.999 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:15.999 [176/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:15.999 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:15.999 [178/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:02:15.999 [179/265] Linking target lib/librte_kvargs.so.24.0 00:02:15.999 [180/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:15.999 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:15.999 [182/265] Linking static target lib/librte_hash.a 00:02:15.999 [183/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:15.999 [184/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.000 [185/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:16.000 [186/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.000 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:16.266 [188/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:16.266 [189/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.266 [190/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:16.266 [191/265] Linking target lib/librte_telemetry.so.24.0 00:02:16.266 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:16.266 [193/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:16.266 [194/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:02:16.266 [195/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.266 [196/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:16.266 [197/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:16.266 [198/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:16.266 [199/265] Linking static target lib/librte_cryptodev.a 00:02:16.266 [200/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:16.266 [201/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:16.266 [202/265] Linking static target drivers/librte_bus_vdev.a 00:02:16.266 [203/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:16.266 [204/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:16.266 [205/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:02:16.266 [206/265] Linking static target drivers/librte_mempool_ring.a 00:02:16.266 [207/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:16.266 [208/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:16.266 [209/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.266 [210/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:16.266 [211/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:16.266 [212/265] Linking static target drivers/librte_bus_pci.a 00:02:16.266 [213/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.526 [214/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.526 [215/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:16.526 [216/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.526 [217/265] Linking static target lib/librte_ethdev.a 00:02:16.526 [218/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.526 [219/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.785 [220/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.785 [221/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:16.785 [222/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:16.786 [223/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:17.046 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:17.614 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:17.614 [226/265] Linking static target lib/librte_vhost.a 00:02:18.184 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:19.567 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:24.850 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:25.788 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.047 [231/265] Linking target lib/librte_eal.so.24.0 00:02:26.047 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:26.047 [233/265] Linking target lib/librte_pci.so.24.0 00:02:26.047 [234/265] Linking target lib/librte_ring.so.24.0 00:02:26.047 [235/265] Linking target lib/librte_meter.so.24.0 00:02:26.047 [236/265] Linking target lib/librte_timer.so.24.0 00:02:26.047 [237/265] Linking target lib/librte_dmadev.so.24.0 00:02:26.047 [238/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:26.306 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:26.306 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:26.306 [241/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:26.306 [242/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:26.306 [243/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:26.306 [244/265] Linking target lib/librte_rcu.so.24.0 00:02:26.306 [245/265] Linking target lib/librte_mempool.so.24.0 00:02:26.306 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:26.306 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:26.566 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:26.566 [249/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:26.566 [250/265] Linking target lib/librte_mbuf.so.24.0 00:02:26.566 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:26.566 [252/265] Linking target lib/librte_net.so.24.0 00:02:26.566 [253/265] Linking target lib/librte_reorder.so.24.0 00:02:26.566 [254/265] Linking target lib/librte_compressdev.so.24.0 00:02:26.566 [255/265] Linking target lib/librte_cryptodev.so.24.0 00:02:26.825 [256/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:26.825 [257/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:26.825 [258/265] Linking target lib/librte_hash.so.24.0 00:02:26.825 [259/265] Linking target lib/librte_cmdline.so.24.0 00:02:26.825 [260/265] Linking target lib/librte_security.so.24.0 00:02:26.825 [261/265] Linking target lib/librte_ethdev.so.24.0 00:02:26.826 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:27.086 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:27.086 [264/265] Linking target lib/librte_power.so.24.0 00:02:27.086 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:27.086 INFO: autodetecting backend as ninja 00:02:27.086 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 112 00:02:28.026 CC lib/ut_mock/mock.o 00:02:28.026 CC lib/ut/ut.o 00:02:28.026 CC lib/log/log.o 00:02:28.026 CC lib/log/log_flags.o 00:02:28.026 CC lib/log/log_deprecated.o 00:02:28.026 LIB libspdk_ut_mock.a 00:02:28.026 LIB libspdk_ut.a 00:02:28.026 LIB libspdk_log.a 00:02:28.286 SO libspdk_ut_mock.so.6.0 00:02:28.286 SO libspdk_ut.so.2.0 00:02:28.286 SO libspdk_log.so.7.0 00:02:28.286 SYMLINK libspdk_ut_mock.so 00:02:28.286 SYMLINK libspdk_ut.so 00:02:28.286 SYMLINK libspdk_log.so 00:02:28.545 CC lib/dma/dma.o 00:02:28.545 CC lib/util/base64.o 00:02:28.545 CC lib/util/bit_array.o 00:02:28.545 CC lib/util/cpuset.o 00:02:28.545 CXX lib/trace_parser/trace.o 00:02:28.545 CC lib/util/crc16.o 00:02:28.545 CC lib/ioat/ioat.o 00:02:28.545 CC lib/util/crc32.o 00:02:28.545 CC lib/util/crc32c.o 00:02:28.545 CC lib/util/crc32_ieee.o 00:02:28.545 CC lib/util/crc64.o 00:02:28.545 CC lib/util/dif.o 00:02:28.545 CC lib/util/fd.o 00:02:28.546 CC lib/util/file.o 00:02:28.546 CC lib/util/hexlify.o 00:02:28.546 CC lib/util/iov.o 00:02:28.546 CC lib/util/math.o 00:02:28.546 CC lib/util/pipe.o 00:02:28.546 CC lib/util/strerror_tls.o 00:02:28.546 CC lib/util/string.o 00:02:28.546 CC lib/util/uuid.o 00:02:28.546 CC lib/util/fd_group.o 00:02:28.546 CC lib/util/xor.o 00:02:28.546 CC lib/util/zipf.o 00:02:28.804 CC lib/vfio_user/host/vfio_user_pci.o 00:02:28.804 LIB libspdk_dma.a 00:02:28.804 CC lib/vfio_user/host/vfio_user.o 00:02:28.804 SO libspdk_dma.so.4.0 00:02:28.804 SYMLINK libspdk_dma.so 00:02:28.804 LIB libspdk_ioat.a 00:02:28.804 SO libspdk_ioat.so.7.0 00:02:28.804 LIB libspdk_vfio_user.a 00:02:28.804 SYMLINK libspdk_ioat.so 00:02:28.804 SO libspdk_vfio_user.so.5.0 00:02:28.804 LIB libspdk_util.a 00:02:29.063 SYMLINK libspdk_vfio_user.so 00:02:29.063 SO libspdk_util.so.9.0 00:02:29.063 SYMLINK libspdk_util.so 00:02:29.322 CC lib/idxd/idxd.o 00:02:29.322 CC lib/idxd/idxd_user.o 00:02:29.322 CC lib/rdma/common.o 00:02:29.322 CC lib/rdma/rdma_verbs.o 00:02:29.322 CC lib/conf/conf.o 00:02:29.322 CC lib/vmd/vmd.o 00:02:29.322 CC lib/vmd/led.o 00:02:29.322 CC lib/json/json_parse.o 00:02:29.322 CC lib/env_dpdk/env.o 00:02:29.322 CC lib/json/json_util.o 00:02:29.322 CC lib/env_dpdk/memory.o 00:02:29.322 CC lib/json/json_write.o 00:02:29.322 CC lib/env_dpdk/pci.o 00:02:29.322 CC lib/env_dpdk/init.o 00:02:29.322 CC lib/env_dpdk/threads.o 00:02:29.322 CC lib/env_dpdk/pci_ioat.o 00:02:29.322 CC lib/env_dpdk/pci_virtio.o 00:02:29.322 CC lib/env_dpdk/pci_vmd.o 00:02:29.322 CC lib/env_dpdk/pci_idxd.o 00:02:29.322 CC lib/env_dpdk/pci_event.o 00:02:29.322 CC lib/env_dpdk/sigbus_handler.o 00:02:29.322 CC lib/env_dpdk/pci_dpdk.o 00:02:29.322 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:29.322 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:29.581 LIB libspdk_conf.a 00:02:29.581 LIB libspdk_rdma.a 00:02:29.581 SO libspdk_conf.so.6.0 00:02:29.581 LIB libspdk_json.a 00:02:29.581 SO libspdk_rdma.so.6.0 00:02:29.581 SYMLINK libspdk_conf.so 00:02:29.581 SO libspdk_json.so.6.0 00:02:29.841 SYMLINK libspdk_rdma.so 00:02:29.841 SYMLINK libspdk_json.so 00:02:29.841 LIB libspdk_idxd.a 00:02:29.841 SO libspdk_idxd.so.12.0 00:02:29.841 LIB libspdk_vmd.a 00:02:29.841 SYMLINK libspdk_idxd.so 00:02:29.841 SO libspdk_vmd.so.6.0 00:02:29.841 LIB libspdk_trace_parser.a 00:02:29.841 SO libspdk_trace_parser.so.5.0 00:02:29.841 SYMLINK libspdk_vmd.so 00:02:30.100 SYMLINK libspdk_trace_parser.so 00:02:30.100 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:30.100 CC lib/jsonrpc/jsonrpc_server.o 00:02:30.101 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:30.101 CC lib/jsonrpc/jsonrpc_client.o 00:02:30.101 LIB libspdk_jsonrpc.a 00:02:30.360 SO libspdk_jsonrpc.so.6.0 00:02:30.360 LIB libspdk_env_dpdk.a 00:02:30.360 SYMLINK libspdk_jsonrpc.so 00:02:30.360 SO libspdk_env_dpdk.so.14.0 00:02:30.360 SYMLINK libspdk_env_dpdk.so 00:02:30.620 CC lib/rpc/rpc.o 00:02:30.881 LIB libspdk_rpc.a 00:02:30.881 SO libspdk_rpc.so.6.0 00:02:30.881 SYMLINK libspdk_rpc.so 00:02:31.141 CC lib/trace/trace.o 00:02:31.142 CC lib/trace/trace_flags.o 00:02:31.142 CC lib/trace/trace_rpc.o 00:02:31.142 CC lib/notify/notify.o 00:02:31.142 CC lib/keyring/keyring.o 00:02:31.142 CC lib/notify/notify_rpc.o 00:02:31.142 CC lib/keyring/keyring_rpc.o 00:02:31.402 LIB libspdk_notify.a 00:02:31.402 LIB libspdk_keyring.a 00:02:31.402 LIB libspdk_trace.a 00:02:31.402 SO libspdk_notify.so.6.0 00:02:31.402 SO libspdk_keyring.so.1.0 00:02:31.402 SO libspdk_trace.so.10.0 00:02:31.402 SYMLINK libspdk_notify.so 00:02:31.402 SYMLINK libspdk_keyring.so 00:02:31.402 SYMLINK libspdk_trace.so 00:02:31.662 CC lib/thread/thread.o 00:02:31.662 CC lib/thread/iobuf.o 00:02:31.662 CC lib/sock/sock.o 00:02:31.662 CC lib/sock/sock_rpc.o 00:02:31.922 LIB libspdk_sock.a 00:02:32.181 SO libspdk_sock.so.9.0 00:02:32.181 SYMLINK libspdk_sock.so 00:02:32.441 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:32.441 CC lib/nvme/nvme_ctrlr.o 00:02:32.441 CC lib/nvme/nvme_fabric.o 00:02:32.441 CC lib/nvme/nvme_ns_cmd.o 00:02:32.441 CC lib/nvme/nvme_ns.o 00:02:32.441 CC lib/nvme/nvme_pcie_common.o 00:02:32.441 CC lib/nvme/nvme_pcie.o 00:02:32.441 CC lib/nvme/nvme_qpair.o 00:02:32.441 CC lib/nvme/nvme.o 00:02:32.441 CC lib/nvme/nvme_quirks.o 00:02:32.441 CC lib/nvme/nvme_transport.o 00:02:32.441 CC lib/nvme/nvme_discovery.o 00:02:32.441 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:32.441 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:32.441 CC lib/nvme/nvme_tcp.o 00:02:32.441 CC lib/nvme/nvme_opal.o 00:02:32.441 CC lib/nvme/nvme_io_msg.o 00:02:32.441 CC lib/nvme/nvme_poll_group.o 00:02:32.441 CC lib/nvme/nvme_zns.o 00:02:32.441 CC lib/nvme/nvme_stubs.o 00:02:32.441 CC lib/nvme/nvme_auth.o 00:02:32.441 CC lib/nvme/nvme_cuse.o 00:02:32.441 CC lib/nvme/nvme_rdma.o 00:02:32.700 LIB libspdk_thread.a 00:02:32.700 SO libspdk_thread.so.10.0 00:02:32.700 SYMLINK libspdk_thread.so 00:02:32.960 CC lib/accel/accel_rpc.o 00:02:32.960 CC lib/accel/accel.o 00:02:32.960 CC lib/accel/accel_sw.o 00:02:32.960 CC lib/blob/blobstore.o 00:02:32.960 CC lib/blob/request.o 00:02:32.960 CC lib/blob/zeroes.o 00:02:32.960 CC lib/blob/blob_bs_dev.o 00:02:32.960 CC lib/init/subsystem_rpc.o 00:02:32.960 CC lib/init/json_config.o 00:02:32.960 CC lib/init/subsystem.o 00:02:32.960 CC lib/init/rpc.o 00:02:32.960 CC lib/virtio/virtio.o 00:02:32.960 CC lib/virtio/virtio_vhost_user.o 00:02:32.960 CC lib/virtio/virtio_vfio_user.o 00:02:32.960 CC lib/virtio/virtio_pci.o 00:02:33.219 LIB libspdk_init.a 00:02:33.219 SO libspdk_init.so.5.0 00:02:33.219 LIB libspdk_virtio.a 00:02:33.479 SO libspdk_virtio.so.7.0 00:02:33.479 SYMLINK libspdk_init.so 00:02:33.479 SYMLINK libspdk_virtio.so 00:02:33.739 CC lib/event/app.o 00:02:33.739 CC lib/event/log_rpc.o 00:02:33.739 CC lib/event/reactor.o 00:02:33.739 CC lib/event/app_rpc.o 00:02:33.739 CC lib/event/scheduler_static.o 00:02:33.739 LIB libspdk_accel.a 00:02:33.739 SO libspdk_accel.so.15.0 00:02:33.739 SYMLINK libspdk_accel.so 00:02:33.739 LIB libspdk_nvme.a 00:02:33.999 SO libspdk_nvme.so.13.0 00:02:33.999 LIB libspdk_event.a 00:02:33.999 SO libspdk_event.so.13.0 00:02:33.999 SYMLINK libspdk_event.so 00:02:33.999 CC lib/bdev/bdev.o 00:02:33.999 CC lib/bdev/part.o 00:02:33.999 CC lib/bdev/bdev_rpc.o 00:02:33.999 CC lib/bdev/bdev_zone.o 00:02:33.999 CC lib/bdev/scsi_nvme.o 00:02:34.259 SYMLINK libspdk_nvme.so 00:02:34.829 LIB libspdk_blob.a 00:02:34.829 SO libspdk_blob.so.11.0 00:02:34.829 SYMLINK libspdk_blob.so 00:02:35.088 CC lib/blobfs/blobfs.o 00:02:35.088 CC lib/lvol/lvol.o 00:02:35.088 CC lib/blobfs/tree.o 00:02:35.658 LIB libspdk_bdev.a 00:02:35.658 LIB libspdk_blobfs.a 00:02:35.658 SO libspdk_bdev.so.15.0 00:02:35.658 LIB libspdk_lvol.a 00:02:35.658 SO libspdk_blobfs.so.10.0 00:02:35.658 SO libspdk_lvol.so.10.0 00:02:35.918 SYMLINK libspdk_blobfs.so 00:02:35.918 SYMLINK libspdk_bdev.so 00:02:35.918 SYMLINK libspdk_lvol.so 00:02:36.175 CC lib/scsi/lun.o 00:02:36.175 CC lib/scsi/dev.o 00:02:36.175 CC lib/scsi/port.o 00:02:36.175 CC lib/scsi/scsi.o 00:02:36.175 CC lib/scsi/scsi_bdev.o 00:02:36.175 CC lib/ublk/ublk.o 00:02:36.175 CC lib/ublk/ublk_rpc.o 00:02:36.175 CC lib/scsi/scsi_pr.o 00:02:36.175 CC lib/scsi/scsi_rpc.o 00:02:36.175 CC lib/nvmf/ctrlr.o 00:02:36.175 CC lib/nvmf/ctrlr_discovery.o 00:02:36.175 CC lib/nvmf/ctrlr_bdev.o 00:02:36.175 CC lib/scsi/task.o 00:02:36.175 CC lib/nvmf/subsystem.o 00:02:36.175 CC lib/nvmf/nvmf.o 00:02:36.175 CC lib/nvmf/nvmf_rpc.o 00:02:36.175 CC lib/ftl/ftl_core.o 00:02:36.175 CC lib/nbd/nbd.o 00:02:36.175 CC lib/ftl/ftl_init.o 00:02:36.175 CC lib/nbd/nbd_rpc.o 00:02:36.175 CC lib/ftl/ftl_layout.o 00:02:36.175 CC lib/nvmf/transport.o 00:02:36.175 CC lib/ftl/ftl_debug.o 00:02:36.175 CC lib/nvmf/tcp.o 00:02:36.175 CC lib/ftl/ftl_io.o 00:02:36.175 CC lib/ftl/ftl_sb.o 00:02:36.175 CC lib/ftl/ftl_l2p.o 00:02:36.175 CC lib/nvmf/rdma.o 00:02:36.175 CC lib/ftl/ftl_l2p_flat.o 00:02:36.175 CC lib/ftl/ftl_nv_cache.o 00:02:36.175 CC lib/ftl/ftl_band.o 00:02:36.175 CC lib/ftl/ftl_band_ops.o 00:02:36.175 CC lib/ftl/ftl_writer.o 00:02:36.175 CC lib/ftl/ftl_rq.o 00:02:36.175 CC lib/ftl/ftl_reloc.o 00:02:36.175 CC lib/ftl/ftl_l2p_cache.o 00:02:36.175 CC lib/ftl/ftl_p2l.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:36.175 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:36.175 CC lib/ftl/utils/ftl_conf.o 00:02:36.175 CC lib/ftl/utils/ftl_md.o 00:02:36.175 CC lib/ftl/utils/ftl_mempool.o 00:02:36.175 CC lib/ftl/utils/ftl_bitmap.o 00:02:36.175 CC lib/ftl/utils/ftl_property.o 00:02:36.175 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:36.175 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:36.175 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:36.175 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:36.175 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:36.175 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:36.175 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:36.175 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:36.175 CC lib/ftl/base/ftl_base_dev.o 00:02:36.175 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:36.175 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:36.175 CC lib/ftl/base/ftl_base_bdev.o 00:02:36.175 CC lib/ftl/ftl_trace.o 00:02:36.742 LIB libspdk_nbd.a 00:02:36.742 LIB libspdk_scsi.a 00:02:36.742 SO libspdk_nbd.so.7.0 00:02:36.742 SO libspdk_scsi.so.9.0 00:02:36.742 SYMLINK libspdk_nbd.so 00:02:36.742 SYMLINK libspdk_scsi.so 00:02:36.742 LIB libspdk_ublk.a 00:02:36.742 SO libspdk_ublk.so.3.0 00:02:36.742 SYMLINK libspdk_ublk.so 00:02:37.002 LIB libspdk_ftl.a 00:02:37.002 CC lib/iscsi/conn.o 00:02:37.002 CC lib/iscsi/init_grp.o 00:02:37.002 CC lib/iscsi/iscsi.o 00:02:37.002 CC lib/iscsi/param.o 00:02:37.002 CC lib/iscsi/md5.o 00:02:37.002 CC lib/iscsi/portal_grp.o 00:02:37.002 CC lib/iscsi/tgt_node.o 00:02:37.002 CC lib/iscsi/iscsi_subsystem.o 00:02:37.002 CC lib/iscsi/iscsi_rpc.o 00:02:37.002 CC lib/iscsi/task.o 00:02:37.002 CC lib/vhost/vhost.o 00:02:37.002 CC lib/vhost/vhost_rpc.o 00:02:37.002 CC lib/vhost/vhost_scsi.o 00:02:37.002 CC lib/vhost/vhost_blk.o 00:02:37.002 CC lib/vhost/rte_vhost_user.o 00:02:37.002 SO libspdk_ftl.so.9.0 00:02:37.262 SYMLINK libspdk_ftl.so 00:02:37.521 LIB libspdk_nvmf.a 00:02:37.521 SO libspdk_nvmf.so.18.0 00:02:37.781 LIB libspdk_vhost.a 00:02:37.781 SYMLINK libspdk_nvmf.so 00:02:37.781 SO libspdk_vhost.so.8.0 00:02:37.781 SYMLINK libspdk_vhost.so 00:02:37.781 LIB libspdk_iscsi.a 00:02:38.040 SO libspdk_iscsi.so.8.0 00:02:38.040 SYMLINK libspdk_iscsi.so 00:02:38.609 CC module/env_dpdk/env_dpdk_rpc.o 00:02:38.609 LIB libspdk_env_dpdk_rpc.a 00:02:38.609 CC module/blob/bdev/blob_bdev.o 00:02:38.609 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:38.609 CC module/accel/error/accel_error.o 00:02:38.609 CC module/accel/error/accel_error_rpc.o 00:02:38.609 CC module/keyring/file/keyring.o 00:02:38.609 CC module/keyring/file/keyring_rpc.o 00:02:38.609 SO libspdk_env_dpdk_rpc.so.6.0 00:02:38.609 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:38.609 CC module/accel/ioat/accel_ioat.o 00:02:38.609 CC module/accel/iaa/accel_iaa.o 00:02:38.609 CC module/accel/ioat/accel_ioat_rpc.o 00:02:38.609 CC module/sock/posix/posix.o 00:02:38.609 CC module/accel/dsa/accel_dsa.o 00:02:38.609 CC module/accel/iaa/accel_iaa_rpc.o 00:02:38.609 CC module/scheduler/gscheduler/gscheduler.o 00:02:38.609 CC module/accel/dsa/accel_dsa_rpc.o 00:02:38.609 SYMLINK libspdk_env_dpdk_rpc.so 00:02:38.869 LIB libspdk_scheduler_dpdk_governor.a 00:02:38.869 LIB libspdk_keyring_file.a 00:02:38.869 LIB libspdk_scheduler_gscheduler.a 00:02:38.869 LIB libspdk_accel_ioat.a 00:02:38.869 LIB libspdk_scheduler_dynamic.a 00:02:38.869 SO libspdk_scheduler_dpdk_governor.so.4.0 00:02:38.869 LIB libspdk_accel_error.a 00:02:38.869 SO libspdk_keyring_file.so.1.0 00:02:38.869 LIB libspdk_accel_iaa.a 00:02:38.869 SO libspdk_scheduler_gscheduler.so.4.0 00:02:38.869 SO libspdk_scheduler_dynamic.so.4.0 00:02:38.869 LIB libspdk_blob_bdev.a 00:02:38.869 SO libspdk_accel_ioat.so.6.0 00:02:38.869 SO libspdk_accel_error.so.2.0 00:02:38.869 LIB libspdk_accel_dsa.a 00:02:38.869 SO libspdk_accel_iaa.so.3.0 00:02:38.869 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:38.869 SYMLINK libspdk_scheduler_gscheduler.so 00:02:38.869 SO libspdk_blob_bdev.so.11.0 00:02:38.869 SYMLINK libspdk_keyring_file.so 00:02:38.869 SO libspdk_accel_dsa.so.5.0 00:02:38.869 SYMLINK libspdk_scheduler_dynamic.so 00:02:38.869 SYMLINK libspdk_accel_ioat.so 00:02:38.869 SYMLINK libspdk_accel_iaa.so 00:02:38.869 SYMLINK libspdk_accel_error.so 00:02:38.869 SYMLINK libspdk_blob_bdev.so 00:02:38.869 SYMLINK libspdk_accel_dsa.so 00:02:39.130 LIB libspdk_sock_posix.a 00:02:39.130 SO libspdk_sock_posix.so.6.0 00:02:39.389 SYMLINK libspdk_sock_posix.so 00:02:39.389 CC module/blobfs/bdev/blobfs_bdev.o 00:02:39.389 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:39.389 CC module/bdev/delay/vbdev_delay.o 00:02:39.389 CC module/bdev/null/bdev_null.o 00:02:39.389 CC module/bdev/error/vbdev_error.o 00:02:39.389 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:39.389 CC module/bdev/error/vbdev_error_rpc.o 00:02:39.389 CC module/bdev/null/bdev_null_rpc.o 00:02:39.389 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:39.389 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:39.389 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:39.389 CC module/bdev/ftl/bdev_ftl.o 00:02:39.389 CC module/bdev/lvol/vbdev_lvol.o 00:02:39.389 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:39.389 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:39.389 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:39.389 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:39.389 CC module/bdev/gpt/gpt.o 00:02:39.389 CC module/bdev/gpt/vbdev_gpt.o 00:02:39.389 CC module/bdev/malloc/bdev_malloc.o 00:02:39.389 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:39.389 CC module/bdev/split/vbdev_split.o 00:02:39.389 CC module/bdev/split/vbdev_split_rpc.o 00:02:39.389 CC module/bdev/passthru/vbdev_passthru.o 00:02:39.389 CC module/bdev/iscsi/bdev_iscsi.o 00:02:39.389 CC module/bdev/raid/bdev_raid.o 00:02:39.389 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:39.389 CC module/bdev/nvme/bdev_nvme.o 00:02:39.389 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:39.389 CC module/bdev/raid/bdev_raid_rpc.o 00:02:39.389 CC module/bdev/aio/bdev_aio.o 00:02:39.389 CC module/bdev/raid/bdev_raid_sb.o 00:02:39.389 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:39.389 CC module/bdev/raid/raid0.o 00:02:39.389 CC module/bdev/raid/raid1.o 00:02:39.389 CC module/bdev/nvme/nvme_rpc.o 00:02:39.389 CC module/bdev/aio/bdev_aio_rpc.o 00:02:39.389 CC module/bdev/raid/concat.o 00:02:39.389 CC module/bdev/nvme/bdev_mdns_client.o 00:02:39.389 CC module/bdev/nvme/vbdev_opal.o 00:02:39.389 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:39.389 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:39.648 LIB libspdk_blobfs_bdev.a 00:02:39.648 SO libspdk_blobfs_bdev.so.6.0 00:02:39.648 LIB libspdk_bdev_error.a 00:02:39.648 LIB libspdk_bdev_split.a 00:02:39.648 SYMLINK libspdk_blobfs_bdev.so 00:02:39.648 LIB libspdk_bdev_ftl.a 00:02:39.648 LIB libspdk_bdev_null.a 00:02:39.648 SO libspdk_bdev_error.so.6.0 00:02:39.648 SO libspdk_bdev_split.so.6.0 00:02:39.648 LIB libspdk_bdev_gpt.a 00:02:39.648 SO libspdk_bdev_null.so.6.0 00:02:39.648 SO libspdk_bdev_ftl.so.6.0 00:02:39.648 LIB libspdk_bdev_passthru.a 00:02:39.648 LIB libspdk_bdev_zone_block.a 00:02:39.648 SO libspdk_bdev_gpt.so.6.0 00:02:39.648 LIB libspdk_bdev_malloc.a 00:02:39.648 SYMLINK libspdk_bdev_error.so 00:02:39.648 SYMLINK libspdk_bdev_split.so 00:02:39.648 LIB libspdk_bdev_iscsi.a 00:02:39.648 SO libspdk_bdev_zone_block.so.6.0 00:02:39.648 SO libspdk_bdev_passthru.so.6.0 00:02:39.648 LIB libspdk_bdev_aio.a 00:02:39.648 SYMLINK libspdk_bdev_null.so 00:02:39.648 SYMLINK libspdk_bdev_gpt.so 00:02:39.648 SYMLINK libspdk_bdev_ftl.so 00:02:39.648 LIB libspdk_bdev_delay.a 00:02:39.648 SO libspdk_bdev_aio.so.6.0 00:02:39.648 SO libspdk_bdev_malloc.so.6.0 00:02:39.648 SO libspdk_bdev_iscsi.so.6.0 00:02:39.907 SYMLINK libspdk_bdev_zone_block.so 00:02:39.907 SYMLINK libspdk_bdev_passthru.so 00:02:39.907 SO libspdk_bdev_delay.so.6.0 00:02:39.907 LIB libspdk_bdev_virtio.a 00:02:39.907 LIB libspdk_bdev_lvol.a 00:02:39.907 SYMLINK libspdk_bdev_aio.so 00:02:39.907 SYMLINK libspdk_bdev_malloc.so 00:02:39.907 SYMLINK libspdk_bdev_iscsi.so 00:02:39.907 SO libspdk_bdev_virtio.so.6.0 00:02:39.907 SO libspdk_bdev_lvol.so.6.0 00:02:39.907 SYMLINK libspdk_bdev_delay.so 00:02:39.907 SYMLINK libspdk_bdev_virtio.so 00:02:39.907 SYMLINK libspdk_bdev_lvol.so 00:02:40.166 LIB libspdk_bdev_raid.a 00:02:40.166 SO libspdk_bdev_raid.so.6.0 00:02:40.166 SYMLINK libspdk_bdev_raid.so 00:02:40.733 LIB libspdk_bdev_nvme.a 00:02:40.733 SO libspdk_bdev_nvme.so.7.0 00:02:40.993 SYMLINK libspdk_bdev_nvme.so 00:02:41.562 CC module/event/subsystems/iobuf/iobuf.o 00:02:41.563 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:41.563 CC module/event/subsystems/scheduler/scheduler.o 00:02:41.563 CC module/event/subsystems/keyring/keyring.o 00:02:41.563 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:41.563 CC module/event/subsystems/sock/sock.o 00:02:41.563 CC module/event/subsystems/vmd/vmd.o 00:02:41.563 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:41.563 LIB libspdk_event_vmd.a 00:02:41.563 LIB libspdk_event_keyring.a 00:02:41.563 LIB libspdk_event_sock.a 00:02:41.563 LIB libspdk_event_scheduler.a 00:02:41.823 LIB libspdk_event_iobuf.a 00:02:41.823 LIB libspdk_event_vhost_blk.a 00:02:41.823 SO libspdk_event_keyring.so.1.0 00:02:41.823 SO libspdk_event_vmd.so.6.0 00:02:41.823 SO libspdk_event_scheduler.so.4.0 00:02:41.823 SO libspdk_event_sock.so.5.0 00:02:41.823 SO libspdk_event_vhost_blk.so.3.0 00:02:41.823 SO libspdk_event_iobuf.so.3.0 00:02:41.823 SYMLINK libspdk_event_keyring.so 00:02:41.823 SYMLINK libspdk_event_vmd.so 00:02:41.823 SYMLINK libspdk_event_scheduler.so 00:02:41.823 SYMLINK libspdk_event_sock.so 00:02:41.823 SYMLINK libspdk_event_vhost_blk.so 00:02:41.823 SYMLINK libspdk_event_iobuf.so 00:02:42.084 CC module/event/subsystems/accel/accel.o 00:02:42.344 LIB libspdk_event_accel.a 00:02:42.344 SO libspdk_event_accel.so.6.0 00:02:42.344 SYMLINK libspdk_event_accel.so 00:02:42.604 CC module/event/subsystems/bdev/bdev.o 00:02:42.864 LIB libspdk_event_bdev.a 00:02:42.864 SO libspdk_event_bdev.so.6.0 00:02:42.864 SYMLINK libspdk_event_bdev.so 00:02:43.124 CC module/event/subsystems/ublk/ublk.o 00:02:43.124 CC module/event/subsystems/nbd/nbd.o 00:02:43.124 CC module/event/subsystems/scsi/scsi.o 00:02:43.124 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:43.124 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:43.384 LIB libspdk_event_ublk.a 00:02:43.384 LIB libspdk_event_nbd.a 00:02:43.384 LIB libspdk_event_scsi.a 00:02:43.384 SO libspdk_event_ublk.so.3.0 00:02:43.384 SO libspdk_event_nbd.so.6.0 00:02:43.384 SO libspdk_event_scsi.so.6.0 00:02:43.384 LIB libspdk_event_nvmf.a 00:02:43.384 SYMLINK libspdk_event_ublk.so 00:02:43.384 SO libspdk_event_nvmf.so.6.0 00:02:43.384 SYMLINK libspdk_event_nbd.so 00:02:43.384 SYMLINK libspdk_event_scsi.so 00:02:43.384 SYMLINK libspdk_event_nvmf.so 00:02:43.644 CC module/event/subsystems/iscsi/iscsi.o 00:02:43.644 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:43.904 LIB libspdk_event_vhost_scsi.a 00:02:43.904 LIB libspdk_event_iscsi.a 00:02:43.904 SO libspdk_event_vhost_scsi.so.3.0 00:02:43.904 SO libspdk_event_iscsi.so.6.0 00:02:43.904 SYMLINK libspdk_event_vhost_scsi.so 00:02:43.904 SYMLINK libspdk_event_iscsi.so 00:02:44.165 SO libspdk.so.6.0 00:02:44.165 SYMLINK libspdk.so 00:02:44.427 CC app/spdk_nvme_identify/identify.o 00:02:44.427 CC app/trace_record/trace_record.o 00:02:44.427 TEST_HEADER include/spdk/accel.h 00:02:44.427 TEST_HEADER include/spdk/accel_module.h 00:02:44.427 TEST_HEADER include/spdk/assert.h 00:02:44.427 CXX app/trace/trace.o 00:02:44.427 TEST_HEADER include/spdk/barrier.h 00:02:44.427 TEST_HEADER include/spdk/base64.h 00:02:44.427 CC app/spdk_nvme_discover/discovery_aer.o 00:02:44.427 TEST_HEADER include/spdk/bdev.h 00:02:44.427 TEST_HEADER include/spdk/bit_array.h 00:02:44.427 TEST_HEADER include/spdk/bdev_zone.h 00:02:44.427 TEST_HEADER include/spdk/bdev_module.h 00:02:44.427 TEST_HEADER include/spdk/bit_pool.h 00:02:44.427 TEST_HEADER include/spdk/blob_bdev.h 00:02:44.427 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:44.427 TEST_HEADER include/spdk/blob.h 00:02:44.427 TEST_HEADER include/spdk/blobfs.h 00:02:44.427 CC app/spdk_top/spdk_top.o 00:02:44.427 TEST_HEADER include/spdk/conf.h 00:02:44.427 TEST_HEADER include/spdk/cpuset.h 00:02:44.427 CC test/rpc_client/rpc_client_test.o 00:02:44.427 TEST_HEADER include/spdk/config.h 00:02:44.427 TEST_HEADER include/spdk/crc16.h 00:02:44.427 TEST_HEADER include/spdk/crc32.h 00:02:44.427 CC app/spdk_lspci/spdk_lspci.o 00:02:44.427 TEST_HEADER include/spdk/crc64.h 00:02:44.427 TEST_HEADER include/spdk/dma.h 00:02:44.427 TEST_HEADER include/spdk/dif.h 00:02:44.427 TEST_HEADER include/spdk/env_dpdk.h 00:02:44.427 TEST_HEADER include/spdk/endian.h 00:02:44.427 TEST_HEADER include/spdk/env.h 00:02:44.427 TEST_HEADER include/spdk/event.h 00:02:44.427 TEST_HEADER include/spdk/fd_group.h 00:02:44.427 TEST_HEADER include/spdk/fd.h 00:02:44.427 TEST_HEADER include/spdk/file.h 00:02:44.427 CC app/iscsi_tgt/iscsi_tgt.o 00:02:44.427 TEST_HEADER include/spdk/ftl.h 00:02:44.427 TEST_HEADER include/spdk/hexlify.h 00:02:44.427 TEST_HEADER include/spdk/histogram_data.h 00:02:44.427 TEST_HEADER include/spdk/gpt_spec.h 00:02:44.427 TEST_HEADER include/spdk/idxd_spec.h 00:02:44.427 CC app/spdk_nvme_perf/perf.o 00:02:44.427 TEST_HEADER include/spdk/idxd.h 00:02:44.427 TEST_HEADER include/spdk/init.h 00:02:44.427 TEST_HEADER include/spdk/ioat.h 00:02:44.427 TEST_HEADER include/spdk/ioat_spec.h 00:02:44.427 TEST_HEADER include/spdk/iscsi_spec.h 00:02:44.427 TEST_HEADER include/spdk/json.h 00:02:44.427 TEST_HEADER include/spdk/keyring.h 00:02:44.427 TEST_HEADER include/spdk/jsonrpc.h 00:02:44.427 TEST_HEADER include/spdk/keyring_module.h 00:02:44.427 CC app/nvmf_tgt/nvmf_main.o 00:02:44.427 TEST_HEADER include/spdk/likely.h 00:02:44.427 TEST_HEADER include/spdk/log.h 00:02:44.427 CC app/spdk_dd/spdk_dd.o 00:02:44.427 CC app/vhost/vhost.o 00:02:44.427 TEST_HEADER include/spdk/lvol.h 00:02:44.427 TEST_HEADER include/spdk/memory.h 00:02:44.427 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:44.427 TEST_HEADER include/spdk/mmio.h 00:02:44.427 TEST_HEADER include/spdk/nbd.h 00:02:44.427 TEST_HEADER include/spdk/notify.h 00:02:44.427 TEST_HEADER include/spdk/nvme.h 00:02:44.427 TEST_HEADER include/spdk/nvme_intel.h 00:02:44.427 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:44.427 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:44.427 TEST_HEADER include/spdk/nvme_spec.h 00:02:44.427 TEST_HEADER include/spdk/nvme_zns.h 00:02:44.427 CC app/spdk_tgt/spdk_tgt.o 00:02:44.427 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:44.427 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:44.427 TEST_HEADER include/spdk/nvmf.h 00:02:44.427 TEST_HEADER include/spdk/nvmf_transport.h 00:02:44.427 TEST_HEADER include/spdk/opal.h 00:02:44.427 TEST_HEADER include/spdk/nvmf_spec.h 00:02:44.427 TEST_HEADER include/spdk/opal_spec.h 00:02:44.427 TEST_HEADER include/spdk/pci_ids.h 00:02:44.427 TEST_HEADER include/spdk/pipe.h 00:02:44.427 TEST_HEADER include/spdk/queue.h 00:02:44.427 TEST_HEADER include/spdk/reduce.h 00:02:44.427 TEST_HEADER include/spdk/rpc.h 00:02:44.427 TEST_HEADER include/spdk/scsi_spec.h 00:02:44.427 TEST_HEADER include/spdk/scheduler.h 00:02:44.427 TEST_HEADER include/spdk/scsi.h 00:02:44.427 TEST_HEADER include/spdk/sock.h 00:02:44.427 TEST_HEADER include/spdk/string.h 00:02:44.427 TEST_HEADER include/spdk/stdinc.h 00:02:44.427 TEST_HEADER include/spdk/trace.h 00:02:44.427 TEST_HEADER include/spdk/thread.h 00:02:44.427 TEST_HEADER include/spdk/tree.h 00:02:44.427 TEST_HEADER include/spdk/trace_parser.h 00:02:44.427 TEST_HEADER include/spdk/ublk.h 00:02:44.427 TEST_HEADER include/spdk/uuid.h 00:02:44.427 TEST_HEADER include/spdk/util.h 00:02:44.694 TEST_HEADER include/spdk/version.h 00:02:44.694 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:44.694 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:44.694 TEST_HEADER include/spdk/vmd.h 00:02:44.694 TEST_HEADER include/spdk/vhost.h 00:02:44.694 TEST_HEADER include/spdk/zipf.h 00:02:44.694 TEST_HEADER include/spdk/xor.h 00:02:44.694 CXX test/cpp_headers/assert.o 00:02:44.694 CXX test/cpp_headers/accel.o 00:02:44.694 CXX test/cpp_headers/accel_module.o 00:02:44.694 CXX test/cpp_headers/barrier.o 00:02:44.694 CXX test/cpp_headers/base64.o 00:02:44.694 CXX test/cpp_headers/bdev.o 00:02:44.694 CXX test/cpp_headers/bit_array.o 00:02:44.694 CXX test/cpp_headers/bdev_zone.o 00:02:44.694 CXX test/cpp_headers/bdev_module.o 00:02:44.694 CXX test/cpp_headers/blob_bdev.o 00:02:44.694 CXX test/cpp_headers/blobfs_bdev.o 00:02:44.694 CXX test/cpp_headers/blobfs.o 00:02:44.694 CXX test/cpp_headers/bit_pool.o 00:02:44.694 CXX test/cpp_headers/conf.o 00:02:44.694 CXX test/cpp_headers/config.o 00:02:44.694 CXX test/cpp_headers/blob.o 00:02:44.694 CXX test/cpp_headers/crc16.o 00:02:44.694 CXX test/cpp_headers/crc32.o 00:02:44.694 CXX test/cpp_headers/cpuset.o 00:02:44.694 CXX test/cpp_headers/dif.o 00:02:44.694 CXX test/cpp_headers/crc64.o 00:02:44.694 CXX test/cpp_headers/dma.o 00:02:44.694 CXX test/cpp_headers/env_dpdk.o 00:02:44.694 CXX test/cpp_headers/endian.o 00:02:44.694 CXX test/cpp_headers/event.o 00:02:44.694 CXX test/cpp_headers/env.o 00:02:44.694 CXX test/cpp_headers/fd.o 00:02:44.694 CXX test/cpp_headers/fd_group.o 00:02:44.694 CXX test/cpp_headers/file.o 00:02:44.694 CXX test/cpp_headers/ftl.o 00:02:44.694 CXX test/cpp_headers/gpt_spec.o 00:02:44.694 CXX test/cpp_headers/hexlify.o 00:02:44.694 CXX test/cpp_headers/histogram_data.o 00:02:44.694 CXX test/cpp_headers/idxd.o 00:02:44.694 CXX test/cpp_headers/idxd_spec.o 00:02:44.694 CXX test/cpp_headers/init.o 00:02:44.694 CXX test/cpp_headers/ioat.o 00:02:44.694 CC examples/vmd/lsvmd/lsvmd.o 00:02:44.694 CC test/env/vtophys/vtophys.o 00:02:44.694 CC test/event/reactor/reactor.o 00:02:44.694 CXX test/cpp_headers/ioat_spec.o 00:02:44.694 CC test/env/memory/memory_ut.o 00:02:44.694 CC examples/vmd/led/led.o 00:02:44.694 CC test/event/event_perf/event_perf.o 00:02:44.694 CC app/fio/nvme/fio_plugin.o 00:02:44.694 CC test/event/app_repeat/app_repeat.o 00:02:44.694 CC examples/idxd/perf/perf.o 00:02:44.694 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:44.694 CC test/nvme/startup/startup.o 00:02:44.694 CC test/event/reactor_perf/reactor_perf.o 00:02:44.694 CC test/nvme/sgl/sgl.o 00:02:44.694 CC test/thread/poller_perf/poller_perf.o 00:02:44.694 CC examples/accel/perf/accel_perf.o 00:02:44.694 CC test/nvme/connect_stress/connect_stress.o 00:02:44.694 CC test/nvme/err_injection/err_injection.o 00:02:44.694 CC examples/util/zipf/zipf.o 00:02:44.694 CC examples/nvme/arbitration/arbitration.o 00:02:44.694 CC examples/nvme/abort/abort.o 00:02:44.694 CC examples/sock/hello_world/hello_sock.o 00:02:44.694 CC test/nvme/cuse/cuse.o 00:02:44.694 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:44.694 CC test/nvme/overhead/overhead.o 00:02:44.694 CC test/env/pci/pci_ut.o 00:02:44.694 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:44.694 CC examples/ioat/perf/perf.o 00:02:44.694 CC test/nvme/reserve/reserve.o 00:02:44.694 CC test/nvme/simple_copy/simple_copy.o 00:02:44.694 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:44.694 CC test/nvme/compliance/nvme_compliance.o 00:02:44.694 CC examples/blob/cli/blobcli.o 00:02:44.694 CC examples/bdev/hello_world/hello_bdev.o 00:02:44.694 CC test/event/scheduler/scheduler.o 00:02:44.694 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:44.694 CC examples/ioat/verify/verify.o 00:02:44.694 CC test/nvme/aer/aer.o 00:02:44.694 CC examples/nvme/hotplug/hotplug.o 00:02:44.694 CC test/nvme/reset/reset.o 00:02:44.694 CC test/app/stub/stub.o 00:02:44.694 CC test/accel/dif/dif.o 00:02:44.694 CC examples/nvme/hello_world/hello_world.o 00:02:44.694 CC test/nvme/boot_partition/boot_partition.o 00:02:44.694 CC test/bdev/bdevio/bdevio.o 00:02:44.694 CC examples/nvme/reconnect/reconnect.o 00:02:44.694 CC test/dma/test_dma/test_dma.o 00:02:44.694 CC test/app/jsoncat/jsoncat.o 00:02:44.694 CC app/fio/bdev/fio_plugin.o 00:02:44.694 CC test/nvme/fused_ordering/fused_ordering.o 00:02:44.694 CC examples/blob/hello_world/hello_blob.o 00:02:44.694 CC examples/thread/thread/thread_ex.o 00:02:44.694 CC test/app/histogram_perf/histogram_perf.o 00:02:44.694 CC examples/bdev/bdevperf/bdevperf.o 00:02:44.964 CC test/nvme/fdp/fdp.o 00:02:44.964 CC test/nvme/e2edp/nvme_dp.o 00:02:44.964 CC test/blobfs/mkfs/mkfs.o 00:02:44.964 CC examples/nvmf/nvmf/nvmf.o 00:02:44.964 LINK spdk_lspci 00:02:44.964 CC test/app/bdev_svc/bdev_svc.o 00:02:44.964 LINK iscsi_tgt 00:02:44.964 LINK interrupt_tgt 00:02:44.964 LINK nvmf_tgt 00:02:44.964 LINK spdk_nvme_discover 00:02:44.964 LINK vhost 00:02:44.964 LINK spdk_tgt 00:02:44.964 CC test/lvol/esnap/esnap.o 00:02:44.964 CC test/env/mem_callbacks/mem_callbacks.o 00:02:45.225 LINK reactor 00:02:45.225 LINK led 00:02:45.225 LINK app_repeat 00:02:45.225 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:45.225 LINK poller_perf 00:02:45.225 CXX test/cpp_headers/iscsi_spec.o 00:02:45.225 LINK jsoncat 00:02:45.225 LINK reactor_perf 00:02:45.225 LINK vtophys 00:02:45.225 LINK rpc_client_test 00:02:45.225 CXX test/cpp_headers/json.o 00:02:45.225 LINK startup 00:02:45.225 LINK connect_stress 00:02:45.225 CXX test/cpp_headers/jsonrpc.o 00:02:45.225 CXX test/cpp_headers/keyring.o 00:02:45.225 CXX test/cpp_headers/keyring_module.o 00:02:45.225 LINK cmb_copy 00:02:45.225 CXX test/cpp_headers/likely.o 00:02:45.225 LINK pmr_persistence 00:02:45.225 CXX test/cpp_headers/log.o 00:02:45.225 LINK boot_partition 00:02:45.225 LINK stub 00:02:45.225 CXX test/cpp_headers/lvol.o 00:02:45.225 LINK doorbell_aers 00:02:45.225 CXX test/cpp_headers/memory.o 00:02:45.225 CXX test/cpp_headers/mmio.o 00:02:45.225 CXX test/cpp_headers/nbd.o 00:02:45.225 LINK reserve 00:02:45.225 LINK histogram_perf 00:02:45.225 CXX test/cpp_headers/notify.o 00:02:45.225 CXX test/cpp_headers/nvme.o 00:02:45.225 LINK lsvmd 00:02:45.225 LINK hello_bdev 00:02:45.225 CXX test/cpp_headers/nvme_intel.o 00:02:45.225 LINK spdk_trace_record 00:02:45.225 CXX test/cpp_headers/nvme_ocssd.o 00:02:45.225 LINK event_perf 00:02:45.225 LINK hello_world 00:02:45.225 LINK scheduler 00:02:45.225 LINK hello_sock 00:02:45.225 LINK sgl 00:02:45.225 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:45.225 LINK zipf 00:02:45.225 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:45.225 LINK env_dpdk_post_init 00:02:45.484 LINK idxd_perf 00:02:45.484 CXX test/cpp_headers/nvme_spec.o 00:02:45.484 CXX test/cpp_headers/nvme_zns.o 00:02:45.484 CXX test/cpp_headers/nvmf_cmd.o 00:02:45.484 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:45.484 CXX test/cpp_headers/nvmf.o 00:02:45.484 CXX test/cpp_headers/nvmf_spec.o 00:02:45.484 CXX test/cpp_headers/nvmf_transport.o 00:02:45.484 CXX test/cpp_headers/opal.o 00:02:45.484 CXX test/cpp_headers/opal_spec.o 00:02:45.484 CXX test/cpp_headers/pci_ids.o 00:02:45.484 LINK arbitration 00:02:45.484 CXX test/cpp_headers/pipe.o 00:02:45.484 CXX test/cpp_headers/queue.o 00:02:45.484 CXX test/cpp_headers/reduce.o 00:02:45.484 CXX test/cpp_headers/rpc.o 00:02:45.484 LINK err_injection 00:02:45.484 CXX test/cpp_headers/scheduler.o 00:02:45.484 CXX test/cpp_headers/scsi.o 00:02:45.484 CXX test/cpp_headers/scsi_spec.o 00:02:45.484 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:45.484 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:45.484 CXX test/cpp_headers/sock.o 00:02:45.484 LINK fused_ordering 00:02:45.484 LINK ioat_perf 00:02:45.484 LINK reconnect 00:02:45.484 CXX test/cpp_headers/stdinc.o 00:02:45.484 CXX test/cpp_headers/string.o 00:02:45.484 CXX test/cpp_headers/thread.o 00:02:45.484 CXX test/cpp_headers/trace_parser.o 00:02:45.484 LINK verify 00:02:45.484 CXX test/cpp_headers/trace.o 00:02:45.484 LINK bdev_svc 00:02:45.484 LINK mkfs 00:02:45.484 CXX test/cpp_headers/tree.o 00:02:45.484 LINK hello_blob 00:02:45.484 LINK spdk_trace 00:02:45.484 LINK simple_copy 00:02:45.484 LINK fdp 00:02:45.484 LINK test_dma 00:02:45.484 CXX test/cpp_headers/ublk.o 00:02:45.484 CXX test/cpp_headers/util.o 00:02:45.484 LINK hotplug 00:02:45.484 CXX test/cpp_headers/version.o 00:02:45.484 CXX test/cpp_headers/uuid.o 00:02:45.484 LINK dif 00:02:45.484 LINK overhead 00:02:45.484 LINK thread 00:02:45.484 LINK reset 00:02:45.484 LINK aer 00:02:45.484 LINK spdk_dd 00:02:45.484 CXX test/cpp_headers/vfio_user_pci.o 00:02:45.484 CXX test/cpp_headers/vfio_user_spec.o 00:02:45.484 CXX test/cpp_headers/vhost.o 00:02:45.484 LINK nvme_dp 00:02:45.484 CXX test/cpp_headers/vmd.o 00:02:45.484 CXX test/cpp_headers/xor.o 00:02:45.484 CXX test/cpp_headers/zipf.o 00:02:45.484 LINK accel_perf 00:02:45.741 LINK nvme_compliance 00:02:45.741 LINK nvmf 00:02:45.741 LINK abort 00:02:45.741 LINK nvme_manage 00:02:45.741 LINK pci_ut 00:02:45.741 LINK nvme_fuzz 00:02:45.741 LINK bdevio 00:02:45.741 LINK spdk_bdev 00:02:45.741 LINK spdk_top 00:02:45.741 LINK blobcli 00:02:45.741 LINK spdk_nvme 00:02:45.741 LINK spdk_nvme_identify 00:02:46.000 LINK memory_ut 00:02:46.000 LINK vhost_fuzz 00:02:46.000 LINK mem_callbacks 00:02:46.000 LINK spdk_nvme_perf 00:02:46.000 LINK cuse 00:02:46.260 LINK bdevperf 00:02:46.829 LINK iscsi_fuzz 00:02:48.209 LINK esnap 00:02:48.469 00:02:48.469 real 0m41.731s 00:02:48.469 user 5m50.416s 00:02:48.469 sys 3m37.724s 00:02:48.469 00:36:55 -- common/autotest_common.sh@1112 -- $ xtrace_disable 00:02:48.469 00:36:55 -- common/autotest_common.sh@10 -- $ set +x 00:02:48.469 ************************************ 00:02:48.469 END TEST make 00:02:48.469 ************************************ 00:02:48.469 00:36:55 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:48.469 00:36:55 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:48.469 00:36:55 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:48.469 00:36:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.469 00:36:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:48.469 00:36:55 -- pm/common@45 -- $ pid=10216 00:02:48.469 00:36:55 -- pm/common@52 -- $ sudo kill -TERM 10216 00:02:48.469 00:36:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.469 00:36:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:48.469 00:36:55 -- pm/common@45 -- $ pid=10219 00:02:48.469 00:36:55 -- pm/common@52 -- $ sudo kill -TERM 10219 00:02:48.469 00:36:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.469 00:36:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:48.469 00:36:55 -- pm/common@45 -- $ pid=10217 00:02:48.469 00:36:55 -- pm/common@52 -- $ sudo kill -TERM 10217 00:02:48.469 00:36:55 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.469 00:36:55 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:48.469 00:36:55 -- pm/common@45 -- $ pid=10218 00:02:48.469 00:36:55 -- pm/common@52 -- $ sudo kill -TERM 10218 00:02:48.729 00:36:55 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:02:48.729 00:36:55 -- nvmf/common.sh@7 -- # uname -s 00:02:48.729 00:36:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:48.729 00:36:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:48.729 00:36:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:48.729 00:36:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:48.729 00:36:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:48.729 00:36:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:48.729 00:36:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:48.729 00:36:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:48.729 00:36:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:48.729 00:36:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:48.729 00:36:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:02:48.729 00:36:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:02:48.729 00:36:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:48.729 00:36:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:48.729 00:36:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:48.729 00:36:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:48.729 00:36:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:02:48.729 00:36:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:48.729 00:36:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:48.729 00:36:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:48.729 00:36:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:48.729 00:36:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:48.729 00:36:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:48.729 00:36:55 -- paths/export.sh@5 -- # export PATH 00:02:48.729 00:36:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:48.729 00:36:55 -- nvmf/common.sh@47 -- # : 0 00:02:48.729 00:36:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:48.729 00:36:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:48.729 00:36:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:48.729 00:36:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:48.729 00:36:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:48.729 00:36:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:48.729 00:36:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:48.729 00:36:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:48.729 00:36:55 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:48.729 00:36:55 -- spdk/autotest.sh@32 -- # uname -s 00:02:48.729 00:36:55 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:48.729 00:36:55 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:48.729 00:36:55 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:48.729 00:36:55 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:48.729 00:36:55 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:48.729 00:36:55 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:48.729 00:36:55 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:48.729 00:36:55 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:48.729 00:36:55 -- spdk/autotest.sh@48 -- # udevadm_pid=69994 00:02:48.729 00:36:55 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:48.729 00:36:55 -- pm/common@17 -- # local monitor 00:02:48.729 00:36:55 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.729 00:36:55 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:48.729 00:36:55 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=69997 00:02:48.729 00:36:55 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.729 00:36:55 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=69999 00:02:48.729 00:36:55 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.729 00:36:55 -- pm/common@21 -- # date +%s 00:02:48.729 00:36:55 -- pm/common@21 -- # date +%s 00:02:48.729 00:36:55 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=70001 00:02:48.729 00:36:55 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:48.729 00:36:55 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=70004 00:02:48.729 00:36:55 -- pm/common@26 -- # sleep 1 00:02:48.729 00:36:55 -- pm/common@21 -- # date +%s 00:02:48.729 00:36:55 -- pm/common@21 -- # date +%s 00:02:48.729 00:36:55 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714084615 00:02:48.729 00:36:55 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714084615 00:02:48.729 00:36:55 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714084615 00:02:48.729 00:36:55 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714084615 00:02:48.989 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714084615_collect-vmstat.pm.log 00:02:48.989 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714084615_collect-cpu-load.pm.log 00:02:48.989 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714084615_collect-cpu-temp.pm.log 00:02:48.989 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714084615_collect-bmc-pm.bmc.pm.log 00:02:49.930 00:36:56 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:49.930 00:36:56 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:49.930 00:36:56 -- common/autotest_common.sh@710 -- # xtrace_disable 00:02:49.930 00:36:56 -- common/autotest_common.sh@10 -- # set +x 00:02:49.930 00:36:56 -- spdk/autotest.sh@59 -- # create_test_list 00:02:49.930 00:36:56 -- common/autotest_common.sh@734 -- # xtrace_disable 00:02:49.930 00:36:56 -- common/autotest_common.sh@10 -- # set +x 00:02:49.930 00:36:56 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:02:49.930 00:36:56 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:49.930 00:36:56 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:49.930 00:36:56 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:02:49.930 00:36:56 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:49.930 00:36:56 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:49.930 00:36:56 -- common/autotest_common.sh@1441 -- # uname 00:02:49.930 00:36:56 -- common/autotest_common.sh@1441 -- # '[' Linux = FreeBSD ']' 00:02:49.930 00:36:56 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:49.930 00:36:56 -- common/autotest_common.sh@1461 -- # uname 00:02:49.930 00:36:56 -- common/autotest_common.sh@1461 -- # [[ Linux = FreeBSD ]] 00:02:49.930 00:36:56 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:49.930 00:36:56 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:49.930 00:36:56 -- spdk/autotest.sh@72 -- # hash lcov 00:02:49.930 00:36:56 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:49.930 00:36:56 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:49.930 --rc lcov_branch_coverage=1 00:02:49.930 --rc lcov_function_coverage=1 00:02:49.930 --rc genhtml_branch_coverage=1 00:02:49.930 --rc genhtml_function_coverage=1 00:02:49.930 --rc genhtml_legend=1 00:02:49.930 --rc geninfo_all_blocks=1 00:02:49.930 ' 00:02:49.930 00:36:56 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:49.930 --rc lcov_branch_coverage=1 00:02:49.930 --rc lcov_function_coverage=1 00:02:49.930 --rc genhtml_branch_coverage=1 00:02:49.930 --rc genhtml_function_coverage=1 00:02:49.930 --rc genhtml_legend=1 00:02:49.930 --rc geninfo_all_blocks=1 00:02:49.930 ' 00:02:49.930 00:36:56 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:49.930 --rc lcov_branch_coverage=1 00:02:49.930 --rc lcov_function_coverage=1 00:02:49.930 --rc genhtml_branch_coverage=1 00:02:49.930 --rc genhtml_function_coverage=1 00:02:49.930 --rc genhtml_legend=1 00:02:49.930 --rc geninfo_all_blocks=1 00:02:49.930 --no-external' 00:02:49.930 00:36:56 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:49.930 --rc lcov_branch_coverage=1 00:02:49.930 --rc lcov_function_coverage=1 00:02:49.930 --rc genhtml_branch_coverage=1 00:02:49.930 --rc genhtml_function_coverage=1 00:02:49.930 --rc genhtml_legend=1 00:02:49.930 --rc geninfo_all_blocks=1 00:02:49.930 --no-external' 00:02:49.930 00:36:56 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:49.930 lcov: LCOV version 1.14 00:02:49.930 00:36:57 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:56.534 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:56.534 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:56.535 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:56.535 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:59.074 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:59.074 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:03:05.647 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:05.647 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:05.647 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:05.647 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:05.647 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:05.647 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:12.219 00:37:18 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:03:12.219 00:37:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:03:12.219 00:37:18 -- common/autotest_common.sh@10 -- # set +x 00:03:12.219 00:37:18 -- spdk/autotest.sh@91 -- # rm -f 00:03:12.219 00:37:18 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.130 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:03:14.130 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:03:14.389 0000:d8:00.0 (8086 0a54): Already using the nvme driver 00:03:15.769 00:37:22 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:03:15.769 00:37:22 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:15.769 00:37:22 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:15.769 00:37:22 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:15.769 00:37:22 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:15.769 00:37:22 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:15.769 00:37:22 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:15.769 00:37:22 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:15.769 00:37:22 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:15.769 00:37:22 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:03:15.769 00:37:22 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:03:15.769 00:37:22 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:03:15.769 00:37:22 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:03:15.769 00:37:22 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:03:15.769 00:37:22 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:15.769 No valid GPT data, bailing 00:03:15.769 00:37:22 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:15.769 00:37:22 -- scripts/common.sh@391 -- # pt= 00:03:15.769 00:37:22 -- scripts/common.sh@392 -- # return 1 00:03:15.769 00:37:22 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:15.769 1+0 records in 00:03:15.769 1+0 records out 00:03:15.769 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00154103 s, 680 MB/s 00:03:15.769 00:37:22 -- spdk/autotest.sh@118 -- # sync 00:03:15.769 00:37:22 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:15.769 00:37:22 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:15.769 00:37:22 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:22.350 00:37:28 -- spdk/autotest.sh@124 -- # uname -s 00:03:22.350 00:37:28 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:03:22.350 00:37:28 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:03:22.350 00:37:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.350 00:37:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.350 00:37:28 -- common/autotest_common.sh@10 -- # set +x 00:03:22.350 ************************************ 00:03:22.350 START TEST setup.sh 00:03:22.350 ************************************ 00:03:22.350 00:37:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:03:22.350 * Looking for test storage... 00:03:22.350 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:22.350 00:37:28 -- setup/test-setup.sh@10 -- # uname -s 00:03:22.350 00:37:28 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:22.350 00:37:28 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:03:22.350 00:37:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.350 00:37:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.350 00:37:28 -- common/autotest_common.sh@10 -- # set +x 00:03:22.351 ************************************ 00:03:22.351 START TEST acl 00:03:22.351 ************************************ 00:03:22.351 00:37:28 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:03:22.351 * Looking for test storage... 00:03:22.351 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:22.351 00:37:28 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:22.351 00:37:28 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:03:22.351 00:37:28 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:03:22.351 00:37:28 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:03:22.351 00:37:28 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:03:22.351 00:37:28 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:03:22.351 00:37:28 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:03:22.351 00:37:28 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:22.351 00:37:28 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:03:22.351 00:37:28 -- setup/acl.sh@12 -- # devs=() 00:03:22.351 00:37:28 -- setup/acl.sh@12 -- # declare -a devs 00:03:22.351 00:37:28 -- setup/acl.sh@13 -- # drivers=() 00:03:22.351 00:37:28 -- setup/acl.sh@13 -- # declare -A drivers 00:03:22.351 00:37:28 -- setup/acl.sh@51 -- # setup reset 00:03:22.351 00:37:28 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:22.351 00:37:28 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:26.547 00:37:33 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:26.547 00:37:33 -- setup/acl.sh@16 -- # local dev driver 00:03:26.547 00:37:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:26.547 00:37:33 -- setup/acl.sh@15 -- # setup output status 00:03:26.547 00:37:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.547 00:37:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:03:29.086 Hugepages 00:03:29.086 node hugesize free / total 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:03:29.086 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:35 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:35 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:35 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # continue 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@19 -- # [[ 0000:d8:00.0 == *:*:*.* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:29.086 00:37:36 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\d\8\:\0\0\.\0* ]] 00:03:29.086 00:37:36 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:29.086 00:37:36 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:29.086 00:37:36 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:29.086 00:37:36 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:29.086 00:37:36 -- setup/acl.sh@54 -- # run_test denied denied 00:03:29.086 00:37:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.086 00:37:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.086 00:37:36 -- common/autotest_common.sh@10 -- # set +x 00:03:29.086 ************************************ 00:03:29.086 START TEST denied 00:03:29.086 ************************************ 00:03:29.086 00:37:36 -- common/autotest_common.sh@1111 -- # denied 00:03:29.086 00:37:36 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:d8:00.0' 00:03:29.086 00:37:36 -- setup/acl.sh@38 -- # setup output config 00:03:29.086 00:37:36 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:d8:00.0' 00:03:29.086 00:37:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.086 00:37:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:34.359 0000:d8:00.0 (8086 0a54): Skipping denied controller at 0000:d8:00.0 00:03:34.359 00:37:40 -- setup/acl.sh@40 -- # verify 0000:d8:00.0 00:03:34.359 00:37:40 -- setup/acl.sh@28 -- # local dev driver 00:03:34.359 00:37:40 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:34.359 00:37:40 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:d8:00.0 ]] 00:03:34.359 00:37:40 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:d8:00.0/driver 00:03:34.359 00:37:40 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:34.359 00:37:40 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:34.359 00:37:40 -- setup/acl.sh@41 -- # setup reset 00:03:34.359 00:37:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:34.359 00:37:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:39.644 00:03:39.644 real 0m9.693s 00:03:39.644 user 0m3.198s 00:03:39.644 sys 0m5.535s 00:03:39.644 00:37:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:39.644 00:37:45 -- common/autotest_common.sh@10 -- # set +x 00:03:39.644 ************************************ 00:03:39.644 END TEST denied 00:03:39.644 ************************************ 00:03:39.644 00:37:45 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:39.644 00:37:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:39.644 00:37:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:39.644 00:37:45 -- common/autotest_common.sh@10 -- # set +x 00:03:39.644 ************************************ 00:03:39.644 START TEST allowed 00:03:39.644 ************************************ 00:03:39.644 00:37:46 -- common/autotest_common.sh@1111 -- # allowed 00:03:39.644 00:37:46 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:d8:00.0 00:03:39.644 00:37:46 -- setup/acl.sh@45 -- # setup output config 00:03:39.644 00:37:46 -- setup/acl.sh@46 -- # grep -E '0000:d8:00.0 .*: nvme -> .*' 00:03:39.644 00:37:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.644 00:37:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:47.774 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:03:47.774 00:37:53 -- setup/acl.sh@47 -- # verify 00:03:47.774 00:37:53 -- setup/acl.sh@28 -- # local dev driver 00:03:47.774 00:37:53 -- setup/acl.sh@48 -- # setup reset 00:03:47.774 00:37:53 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:47.774 00:37:53 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:51.068 00:03:51.068 real 0m11.928s 00:03:51.068 user 0m3.126s 00:03:51.068 sys 0m5.463s 00:03:51.068 00:37:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:51.068 00:37:58 -- common/autotest_common.sh@10 -- # set +x 00:03:51.068 ************************************ 00:03:51.068 END TEST allowed 00:03:51.068 ************************************ 00:03:51.068 00:03:51.068 real 0m29.321s 00:03:51.068 user 0m9.259s 00:03:51.068 sys 0m15.935s 00:03:51.068 00:37:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:51.068 00:37:58 -- common/autotest_common.sh@10 -- # set +x 00:03:51.068 ************************************ 00:03:51.068 END TEST acl 00:03:51.068 ************************************ 00:03:51.068 00:37:58 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:51.068 00:37:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:51.068 00:37:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:51.068 00:37:58 -- common/autotest_common.sh@10 -- # set +x 00:03:51.068 ************************************ 00:03:51.068 START TEST hugepages 00:03:51.068 ************************************ 00:03:51.068 00:37:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:51.330 * Looking for test storage... 00:03:51.330 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:51.330 00:37:58 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:51.330 00:37:58 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:51.330 00:37:58 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:51.330 00:37:58 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:51.330 00:37:58 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:51.330 00:37:58 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:51.330 00:37:58 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:51.330 00:37:58 -- setup/common.sh@18 -- # local node= 00:03:51.330 00:37:58 -- setup/common.sh@19 -- # local var val 00:03:51.330 00:37:58 -- setup/common.sh@20 -- # local mem_f mem 00:03:51.330 00:37:58 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:51.330 00:37:58 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:51.330 00:37:58 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:51.330 00:37:58 -- setup/common.sh@28 -- # mapfile -t mem 00:03:51.330 00:37:58 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 77021304 kB' 'MemAvailable: 80502944 kB' 'Buffers: 12936 kB' 'Cached: 9156616 kB' 'SwapCached: 0 kB' 'Active: 6474484 kB' 'Inactive: 3422668 kB' 'Active(anon): 5923828 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 731552 kB' 'Mapped: 145284 kB' 'Shmem: 5196228 kB' 'KReclaimable: 208588 kB' 'Slab: 613472 kB' 'SReclaimable: 208588 kB' 'SUnreclaim: 404884 kB' 'KernelStack: 22496 kB' 'PageTables: 8556 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52949036 kB' 'Committed_AS: 8200624 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214744 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.330 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.330 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # continue 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # IFS=': ' 00:03:51.331 00:37:58 -- setup/common.sh@31 -- # read -r var val _ 00:03:51.331 00:37:58 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:51.331 00:37:58 -- setup/common.sh@33 -- # echo 2048 00:03:51.331 00:37:58 -- setup/common.sh@33 -- # return 0 00:03:51.331 00:37:58 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:51.331 00:37:58 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:51.331 00:37:58 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:51.331 00:37:58 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:51.331 00:37:58 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:51.331 00:37:58 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:51.331 00:37:58 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:51.331 00:37:58 -- setup/hugepages.sh@207 -- # get_nodes 00:03:51.331 00:37:58 -- setup/hugepages.sh@27 -- # local node 00:03:51.331 00:37:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.331 00:37:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:51.331 00:37:58 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:51.331 00:37:58 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:51.331 00:37:58 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:51.331 00:37:58 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:51.331 00:37:58 -- setup/hugepages.sh@208 -- # clear_hp 00:03:51.331 00:37:58 -- setup/hugepages.sh@37 -- # local node hp 00:03:51.331 00:37:58 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:51.331 00:37:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:51.331 00:37:58 -- setup/hugepages.sh@41 -- # echo 0 00:03:51.331 00:37:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:51.331 00:37:58 -- setup/hugepages.sh@41 -- # echo 0 00:03:51.331 00:37:58 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:51.331 00:37:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:51.331 00:37:58 -- setup/hugepages.sh@41 -- # echo 0 00:03:51.332 00:37:58 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:51.332 00:37:58 -- setup/hugepages.sh@41 -- # echo 0 00:03:51.332 00:37:58 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:51.332 00:37:58 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:51.332 00:37:58 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:51.332 00:37:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:51.332 00:37:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:51.332 00:37:58 -- common/autotest_common.sh@10 -- # set +x 00:03:51.592 ************************************ 00:03:51.592 START TEST default_setup 00:03:51.592 ************************************ 00:03:51.592 00:37:58 -- common/autotest_common.sh@1111 -- # default_setup 00:03:51.592 00:37:58 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:51.592 00:37:58 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:51.592 00:37:58 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:51.592 00:37:58 -- setup/hugepages.sh@51 -- # shift 00:03:51.592 00:37:58 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:51.592 00:37:58 -- setup/hugepages.sh@52 -- # local node_ids 00:03:51.592 00:37:58 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:51.592 00:37:58 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:51.592 00:37:58 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:51.592 00:37:58 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:51.592 00:37:58 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:51.592 00:37:58 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:51.592 00:37:58 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:51.592 00:37:58 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:51.592 00:37:58 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:51.592 00:37:58 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:51.592 00:37:58 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:51.592 00:37:58 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:51.592 00:37:58 -- setup/hugepages.sh@73 -- # return 0 00:03:51.592 00:37:58 -- setup/hugepages.sh@137 -- # setup output 00:03:51.592 00:37:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:51.592 00:37:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:54.130 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:54.130 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:54.130 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:54.393 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:54.394 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:57.684 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:03:59.067 00:38:06 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:59.067 00:38:06 -- setup/hugepages.sh@89 -- # local node 00:03:59.067 00:38:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:59.067 00:38:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:59.067 00:38:06 -- setup/hugepages.sh@92 -- # local surp 00:03:59.067 00:38:06 -- setup/hugepages.sh@93 -- # local resv 00:03:59.067 00:38:06 -- setup/hugepages.sh@94 -- # local anon 00:03:59.067 00:38:06 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:59.067 00:38:06 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:59.067 00:38:06 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:59.067 00:38:06 -- setup/common.sh@18 -- # local node= 00:03:59.067 00:38:06 -- setup/common.sh@19 -- # local var val 00:03:59.067 00:38:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.067 00:38:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.067 00:38:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.067 00:38:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.067 00:38:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.067 00:38:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79167688 kB' 'MemAvailable: 82648760 kB' 'Buffers: 12936 kB' 'Cached: 9156788 kB' 'SwapCached: 0 kB' 'Active: 6499044 kB' 'Inactive: 3422668 kB' 'Active(anon): 5948388 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 754924 kB' 'Mapped: 146068 kB' 'Shmem: 5196400 kB' 'KReclaimable: 207456 kB' 'Slab: 609460 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 402004 kB' 'KernelStack: 22320 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8220332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214664 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.067 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.067 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:59.068 00:38:06 -- setup/common.sh@33 -- # echo 0 00:03:59.068 00:38:06 -- setup/common.sh@33 -- # return 0 00:03:59.068 00:38:06 -- setup/hugepages.sh@97 -- # anon=0 00:03:59.068 00:38:06 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:59.068 00:38:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.068 00:38:06 -- setup/common.sh@18 -- # local node= 00:03:59.068 00:38:06 -- setup/common.sh@19 -- # local var val 00:03:59.068 00:38:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.068 00:38:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.068 00:38:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.068 00:38:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.068 00:38:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.068 00:38:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79167840 kB' 'MemAvailable: 82648912 kB' 'Buffers: 12936 kB' 'Cached: 9156792 kB' 'SwapCached: 0 kB' 'Active: 6501108 kB' 'Inactive: 3422668 kB' 'Active(anon): 5950452 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 757416 kB' 'Mapped: 146268 kB' 'Shmem: 5196404 kB' 'KReclaimable: 207456 kB' 'Slab: 609488 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 402032 kB' 'KernelStack: 22368 kB' 'PageTables: 8336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8222336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214636 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.068 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.068 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.069 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.069 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.069 00:38:06 -- setup/common.sh@33 -- # echo 0 00:03:59.069 00:38:06 -- setup/common.sh@33 -- # return 0 00:03:59.069 00:38:06 -- setup/hugepages.sh@99 -- # surp=0 00:03:59.069 00:38:06 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:59.069 00:38:06 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:59.069 00:38:06 -- setup/common.sh@18 -- # local node= 00:03:59.069 00:38:06 -- setup/common.sh@19 -- # local var val 00:03:59.069 00:38:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.069 00:38:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.070 00:38:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.070 00:38:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.070 00:38:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.070 00:38:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79174656 kB' 'MemAvailable: 82655728 kB' 'Buffers: 12936 kB' 'Cached: 9156804 kB' 'SwapCached: 0 kB' 'Active: 6496112 kB' 'Inactive: 3422668 kB' 'Active(anon): 5945456 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 752504 kB' 'Mapped: 145376 kB' 'Shmem: 5196416 kB' 'KReclaimable: 207456 kB' 'Slab: 609488 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 402032 kB' 'KernelStack: 22432 kB' 'PageTables: 8504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8216228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214664 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.070 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.070 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:59.071 00:38:06 -- setup/common.sh@33 -- # echo 0 00:03:59.071 00:38:06 -- setup/common.sh@33 -- # return 0 00:03:59.071 00:38:06 -- setup/hugepages.sh@100 -- # resv=0 00:03:59.071 00:38:06 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:59.071 nr_hugepages=1024 00:03:59.071 00:38:06 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:59.071 resv_hugepages=0 00:03:59.071 00:38:06 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:59.071 surplus_hugepages=0 00:03:59.071 00:38:06 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:59.071 anon_hugepages=0 00:03:59.071 00:38:06 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:59.071 00:38:06 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:59.071 00:38:06 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:59.071 00:38:06 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:59.071 00:38:06 -- setup/common.sh@18 -- # local node= 00:03:59.071 00:38:06 -- setup/common.sh@19 -- # local var val 00:03:59.071 00:38:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.071 00:38:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.071 00:38:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:59.071 00:38:06 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:59.071 00:38:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.071 00:38:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79174180 kB' 'MemAvailable: 82655252 kB' 'Buffers: 12936 kB' 'Cached: 9156804 kB' 'SwapCached: 0 kB' 'Active: 6495848 kB' 'Inactive: 3422668 kB' 'Active(anon): 5945192 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 752216 kB' 'Mapped: 145376 kB' 'Shmem: 5196416 kB' 'KReclaimable: 207456 kB' 'Slab: 609488 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 402032 kB' 'KernelStack: 22368 kB' 'PageTables: 8316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8216244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214616 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.071 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.071 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.072 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.072 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:59.073 00:38:06 -- setup/common.sh@33 -- # echo 1024 00:03:59.073 00:38:06 -- setup/common.sh@33 -- # return 0 00:03:59.073 00:38:06 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:59.073 00:38:06 -- setup/hugepages.sh@112 -- # get_nodes 00:03:59.073 00:38:06 -- setup/hugepages.sh@27 -- # local node 00:03:59.073 00:38:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.073 00:38:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:59.073 00:38:06 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:59.073 00:38:06 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:59.073 00:38:06 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:59.073 00:38:06 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:59.073 00:38:06 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:59.073 00:38:06 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:59.073 00:38:06 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:59.073 00:38:06 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:59.073 00:38:06 -- setup/common.sh@18 -- # local node=0 00:03:59.073 00:38:06 -- setup/common.sh@19 -- # local var val 00:03:59.073 00:38:06 -- setup/common.sh@20 -- # local mem_f mem 00:03:59.073 00:38:06 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:59.073 00:38:06 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:59.073 00:38:06 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:59.073 00:38:06 -- setup/common.sh@28 -- # mapfile -t mem 00:03:59.073 00:38:06 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 26907724 kB' 'MemUsed: 5674232 kB' 'SwapCached: 0 kB' 'Active: 2012104 kB' 'Inactive: 195176 kB' 'Active(anon): 1818680 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1622848 kB' 'Mapped: 46728 kB' 'AnonPages: 587616 kB' 'Shmem: 1234248 kB' 'KernelStack: 12856 kB' 'PageTables: 5108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97504 kB' 'Slab: 320496 kB' 'SReclaimable: 97504 kB' 'SUnreclaim: 222992 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.073 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.073 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # continue 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # IFS=': ' 00:03:59.074 00:38:06 -- setup/common.sh@31 -- # read -r var val _ 00:03:59.074 00:38:06 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:59.074 00:38:06 -- setup/common.sh@33 -- # echo 0 00:03:59.074 00:38:06 -- setup/common.sh@33 -- # return 0 00:03:59.074 00:38:06 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:59.074 00:38:06 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:59.074 00:38:06 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:59.074 00:38:06 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:59.074 00:38:06 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:59.074 node0=1024 expecting 1024 00:03:59.074 00:38:06 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:59.074 00:03:59.074 real 0m7.684s 00:03:59.074 user 0m1.657s 00:03:59.074 sys 0m2.760s 00:03:59.074 00:38:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:03:59.074 00:38:06 -- common/autotest_common.sh@10 -- # set +x 00:03:59.074 ************************************ 00:03:59.074 END TEST default_setup 00:03:59.074 ************************************ 00:03:59.074 00:38:06 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:59.074 00:38:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:59.074 00:38:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:59.074 00:38:06 -- common/autotest_common.sh@10 -- # set +x 00:03:59.334 ************************************ 00:03:59.334 START TEST per_node_1G_alloc 00:03:59.334 ************************************ 00:03:59.334 00:38:06 -- common/autotest_common.sh@1111 -- # per_node_1G_alloc 00:03:59.334 00:38:06 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:59.334 00:38:06 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:59.334 00:38:06 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:59.334 00:38:06 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:59.334 00:38:06 -- setup/hugepages.sh@51 -- # shift 00:03:59.334 00:38:06 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:59.334 00:38:06 -- setup/hugepages.sh@52 -- # local node_ids 00:03:59.334 00:38:06 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:59.334 00:38:06 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:59.334 00:38:06 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:59.334 00:38:06 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:59.334 00:38:06 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:59.334 00:38:06 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:59.334 00:38:06 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:59.334 00:38:06 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:59.334 00:38:06 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:59.334 00:38:06 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:59.334 00:38:06 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:59.334 00:38:06 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:59.334 00:38:06 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:59.334 00:38:06 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:59.334 00:38:06 -- setup/hugepages.sh@73 -- # return 0 00:03:59.334 00:38:06 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:59.334 00:38:06 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:59.334 00:38:06 -- setup/hugepages.sh@146 -- # setup output 00:03:59.334 00:38:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:59.334 00:38:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:02.627 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:02.627 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:03.569 00:38:10 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:03.569 00:38:10 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:03.570 00:38:10 -- setup/hugepages.sh@89 -- # local node 00:04:03.570 00:38:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:03.570 00:38:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:03.570 00:38:10 -- setup/hugepages.sh@92 -- # local surp 00:04:03.570 00:38:10 -- setup/hugepages.sh@93 -- # local resv 00:04:03.570 00:38:10 -- setup/hugepages.sh@94 -- # local anon 00:04:03.570 00:38:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:03.570 00:38:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:03.570 00:38:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:03.570 00:38:10 -- setup/common.sh@18 -- # local node= 00:04:03.570 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.570 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.570 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.570 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.570 00:38:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.570 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.570 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79180516 kB' 'MemAvailable: 82661588 kB' 'Buffers: 12936 kB' 'Cached: 9156932 kB' 'SwapCached: 0 kB' 'Active: 6499256 kB' 'Inactive: 3422668 kB' 'Active(anon): 5948600 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 755308 kB' 'Mapped: 145076 kB' 'Shmem: 5196544 kB' 'KReclaimable: 207456 kB' 'Slab: 609328 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 401872 kB' 'KernelStack: 22320 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8208840 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214440 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.570 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.570 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:03.571 00:38:10 -- setup/common.sh@33 -- # echo 0 00:04:03.571 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.571 00:38:10 -- setup/hugepages.sh@97 -- # anon=0 00:04:03.571 00:38:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:03.571 00:38:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.571 00:38:10 -- setup/common.sh@18 -- # local node= 00:04:03.571 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.571 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.571 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.571 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.571 00:38:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.571 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.571 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79180064 kB' 'MemAvailable: 82661136 kB' 'Buffers: 12936 kB' 'Cached: 9156936 kB' 'SwapCached: 0 kB' 'Active: 6498676 kB' 'Inactive: 3422668 kB' 'Active(anon): 5948020 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 755068 kB' 'Mapped: 144544 kB' 'Shmem: 5196548 kB' 'KReclaimable: 207456 kB' 'Slab: 609296 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 401840 kB' 'KernelStack: 22320 kB' 'PageTables: 8092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8208852 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214408 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.571 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.571 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.572 00:38:10 -- setup/common.sh@33 -- # echo 0 00:04:03.572 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.572 00:38:10 -- setup/hugepages.sh@99 -- # surp=0 00:04:03.572 00:38:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:03.572 00:38:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:03.572 00:38:10 -- setup/common.sh@18 -- # local node= 00:04:03.572 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.572 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.572 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.572 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.572 00:38:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.572 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.572 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79180196 kB' 'MemAvailable: 82661268 kB' 'Buffers: 12936 kB' 'Cached: 9156944 kB' 'SwapCached: 0 kB' 'Active: 6498648 kB' 'Inactive: 3422668 kB' 'Active(anon): 5947992 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 755068 kB' 'Mapped: 144544 kB' 'Shmem: 5196556 kB' 'KReclaimable: 207456 kB' 'Slab: 609296 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 401840 kB' 'KernelStack: 22320 kB' 'PageTables: 8092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8208868 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214408 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.572 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.572 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.573 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.573 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:03.574 00:38:10 -- setup/common.sh@33 -- # echo 0 00:04:03.574 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.574 00:38:10 -- setup/hugepages.sh@100 -- # resv=0 00:04:03.574 00:38:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:03.574 nr_hugepages=1024 00:04:03.574 00:38:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:03.574 resv_hugepages=0 00:04:03.574 00:38:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:03.574 surplus_hugepages=0 00:04:03.574 00:38:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:03.574 anon_hugepages=0 00:04:03.574 00:38:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:03.574 00:38:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:03.574 00:38:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:03.574 00:38:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:03.574 00:38:10 -- setup/common.sh@18 -- # local node= 00:04:03.574 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.574 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.574 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.574 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:03.574 00:38:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:03.574 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.574 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79180952 kB' 'MemAvailable: 82662024 kB' 'Buffers: 12936 kB' 'Cached: 9156944 kB' 'SwapCached: 0 kB' 'Active: 6498304 kB' 'Inactive: 3422668 kB' 'Active(anon): 5947648 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 754724 kB' 'Mapped: 144544 kB' 'Shmem: 5196556 kB' 'KReclaimable: 207456 kB' 'Slab: 609296 kB' 'SReclaimable: 207456 kB' 'SUnreclaim: 401840 kB' 'KernelStack: 22304 kB' 'PageTables: 8044 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8208880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214408 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.574 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.574 00:38:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:03.575 00:38:10 -- setup/common.sh@33 -- # echo 1024 00:04:03.575 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.575 00:38:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:03.575 00:38:10 -- setup/hugepages.sh@112 -- # get_nodes 00:04:03.575 00:38:10 -- setup/hugepages.sh@27 -- # local node 00:04:03.575 00:38:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.575 00:38:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:03.575 00:38:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:03.575 00:38:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:03.575 00:38:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:03.575 00:38:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:03.575 00:38:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.575 00:38:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.575 00:38:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:03.575 00:38:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.575 00:38:10 -- setup/common.sh@18 -- # local node=0 00:04:03.575 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.575 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.575 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.575 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:03.575 00:38:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:03.575 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.575 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.575 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.575 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 27947228 kB' 'MemUsed: 4634728 kB' 'SwapCached: 0 kB' 'Active: 2018116 kB' 'Inactive: 195176 kB' 'Active(anon): 1824692 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1622956 kB' 'Mapped: 45832 kB' 'AnonPages: 593848 kB' 'Shmem: 1234356 kB' 'KernelStack: 12888 kB' 'PageTables: 5244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97568 kB' 'Slab: 320472 kB' 'SReclaimable: 97568 kB' 'SUnreclaim: 222904 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.576 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.576 00:38:10 -- setup/common.sh@33 -- # echo 0 00:04:03.576 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.576 00:38:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.576 00:38:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:03.576 00:38:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:03.576 00:38:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:03.576 00:38:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:03.576 00:38:10 -- setup/common.sh@18 -- # local node=1 00:04:03.576 00:38:10 -- setup/common.sh@19 -- # local var val 00:04:03.576 00:38:10 -- setup/common.sh@20 -- # local mem_f mem 00:04:03.576 00:38:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:03.576 00:38:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:03.576 00:38:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:03.576 00:38:10 -- setup/common.sh@28 -- # mapfile -t mem 00:04:03.576 00:38:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.576 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60733216 kB' 'MemFree: 51235464 kB' 'MemUsed: 9497752 kB' 'SwapCached: 0 kB' 'Active: 4481364 kB' 'Inactive: 3227492 kB' 'Active(anon): 4124132 kB' 'Inactive(anon): 0 kB' 'Active(file): 357232 kB' 'Inactive(file): 3227492 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7546956 kB' 'Mapped: 98712 kB' 'AnonPages: 162004 kB' 'Shmem: 3962232 kB' 'KernelStack: 9416 kB' 'PageTables: 2836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 109888 kB' 'Slab: 288824 kB' 'SReclaimable: 109888 kB' 'SUnreclaim: 178936 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # continue 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # IFS=': ' 00:04:03.577 00:38:10 -- setup/common.sh@31 -- # read -r var val _ 00:04:03.577 00:38:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:03.577 00:38:10 -- setup/common.sh@33 -- # echo 0 00:04:03.577 00:38:10 -- setup/common.sh@33 -- # return 0 00:04:03.577 00:38:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:03.577 00:38:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.577 00:38:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.577 00:38:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.578 00:38:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:03.578 node0=512 expecting 512 00:04:03.578 00:38:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:03.578 00:38:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:03.578 00:38:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:03.578 00:38:10 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:03.578 node1=512 expecting 512 00:04:03.578 00:38:10 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:03.578 00:04:03.578 real 0m4.260s 00:04:03.578 user 0m1.653s 00:04:03.578 sys 0m2.623s 00:04:03.578 00:38:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:03.578 00:38:10 -- common/autotest_common.sh@10 -- # set +x 00:04:03.578 ************************************ 00:04:03.578 END TEST per_node_1G_alloc 00:04:03.578 ************************************ 00:04:03.578 00:38:10 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:03.578 00:38:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:03.578 00:38:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:03.578 00:38:10 -- common/autotest_common.sh@10 -- # set +x 00:04:03.837 ************************************ 00:04:03.837 START TEST even_2G_alloc 00:04:03.837 ************************************ 00:04:03.837 00:38:10 -- common/autotest_common.sh@1111 -- # even_2G_alloc 00:04:03.837 00:38:10 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:03.837 00:38:10 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:03.837 00:38:10 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:03.837 00:38:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:03.837 00:38:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:03.837 00:38:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:03.837 00:38:10 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:03.837 00:38:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:03.838 00:38:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:03.838 00:38:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:03.838 00:38:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:03.838 00:38:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:03.838 00:38:10 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:03.838 00:38:10 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:03.838 00:38:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.838 00:38:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:03.838 00:38:10 -- setup/hugepages.sh@83 -- # : 512 00:04:03.838 00:38:10 -- setup/hugepages.sh@84 -- # : 1 00:04:03.838 00:38:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.838 00:38:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:03.838 00:38:10 -- setup/hugepages.sh@83 -- # : 0 00:04:03.838 00:38:10 -- setup/hugepages.sh@84 -- # : 0 00:04:03.838 00:38:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:03.838 00:38:10 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:03.838 00:38:10 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:03.838 00:38:10 -- setup/hugepages.sh@153 -- # setup output 00:04:03.838 00:38:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.838 00:38:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:06.378 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:06.378 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:06.638 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:06.638 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:06.638 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:06.638 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:06.638 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:08.023 00:38:14 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:08.023 00:38:14 -- setup/hugepages.sh@89 -- # local node 00:04:08.023 00:38:14 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:08.023 00:38:14 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:08.023 00:38:14 -- setup/hugepages.sh@92 -- # local surp 00:04:08.023 00:38:14 -- setup/hugepages.sh@93 -- # local resv 00:04:08.023 00:38:14 -- setup/hugepages.sh@94 -- # local anon 00:04:08.023 00:38:14 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:08.023 00:38:14 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:08.023 00:38:14 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:08.023 00:38:14 -- setup/common.sh@18 -- # local node= 00:04:08.023 00:38:14 -- setup/common.sh@19 -- # local var val 00:04:08.023 00:38:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.023 00:38:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.023 00:38:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:08.023 00:38:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:08.023 00:38:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.023 00:38:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79155248 kB' 'MemAvailable: 82636228 kB' 'Buffers: 12936 kB' 'Cached: 9157088 kB' 'SwapCached: 0 kB' 'Active: 6504724 kB' 'Inactive: 3422668 kB' 'Active(anon): 5954068 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 760640 kB' 'Mapped: 144692 kB' 'Shmem: 5196700 kB' 'KReclaimable: 207272 kB' 'Slab: 609740 kB' 'SReclaimable: 207272 kB' 'SUnreclaim: 402468 kB' 'KernelStack: 22192 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8209296 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214600 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.023 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.023 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:08.024 00:38:14 -- setup/common.sh@33 -- # echo 0 00:04:08.024 00:38:14 -- setup/common.sh@33 -- # return 0 00:04:08.024 00:38:14 -- setup/hugepages.sh@97 -- # anon=0 00:04:08.024 00:38:14 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:08.024 00:38:14 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:08.024 00:38:14 -- setup/common.sh@18 -- # local node= 00:04:08.024 00:38:14 -- setup/common.sh@19 -- # local var val 00:04:08.024 00:38:14 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.024 00:38:14 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.024 00:38:14 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:08.024 00:38:14 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:08.024 00:38:14 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.024 00:38:14 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79154664 kB' 'MemAvailable: 82635644 kB' 'Buffers: 12936 kB' 'Cached: 9157092 kB' 'SwapCached: 0 kB' 'Active: 6503724 kB' 'Inactive: 3422668 kB' 'Active(anon): 5953068 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 759704 kB' 'Mapped: 144632 kB' 'Shmem: 5196704 kB' 'KReclaimable: 207272 kB' 'Slab: 609772 kB' 'SReclaimable: 207272 kB' 'SUnreclaim: 402500 kB' 'KernelStack: 22400 kB' 'PageTables: 8568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8210456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214664 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.024 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.024 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:14 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:14 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.025 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.025 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.026 00:38:15 -- setup/common.sh@33 -- # echo 0 00:04:08.026 00:38:15 -- setup/common.sh@33 -- # return 0 00:04:08.026 00:38:15 -- setup/hugepages.sh@99 -- # surp=0 00:04:08.026 00:38:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:08.026 00:38:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:08.026 00:38:15 -- setup/common.sh@18 -- # local node= 00:04:08.026 00:38:15 -- setup/common.sh@19 -- # local var val 00:04:08.026 00:38:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.026 00:38:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.026 00:38:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:08.026 00:38:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:08.026 00:38:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.026 00:38:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79152980 kB' 'MemAvailable: 82633960 kB' 'Buffers: 12936 kB' 'Cached: 9157104 kB' 'SwapCached: 0 kB' 'Active: 6503560 kB' 'Inactive: 3422668 kB' 'Active(anon): 5952904 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 759428 kB' 'Mapped: 144632 kB' 'Shmem: 5196716 kB' 'KReclaimable: 207272 kB' 'Slab: 609772 kB' 'SReclaimable: 207272 kB' 'SUnreclaim: 402500 kB' 'KernelStack: 22432 kB' 'PageTables: 8432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8210472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214712 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.026 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.026 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:08.027 00:38:15 -- setup/common.sh@33 -- # echo 0 00:04:08.027 00:38:15 -- setup/common.sh@33 -- # return 0 00:04:08.027 00:38:15 -- setup/hugepages.sh@100 -- # resv=0 00:04:08.027 00:38:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:08.027 nr_hugepages=1024 00:04:08.027 00:38:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:08.027 resv_hugepages=0 00:04:08.027 00:38:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:08.027 surplus_hugepages=0 00:04:08.027 00:38:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:08.027 anon_hugepages=0 00:04:08.027 00:38:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:08.027 00:38:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:08.027 00:38:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:08.027 00:38:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:08.027 00:38:15 -- setup/common.sh@18 -- # local node= 00:04:08.027 00:38:15 -- setup/common.sh@19 -- # local var val 00:04:08.027 00:38:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.027 00:38:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.027 00:38:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:08.027 00:38:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:08.027 00:38:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.027 00:38:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79151000 kB' 'MemAvailable: 82631980 kB' 'Buffers: 12936 kB' 'Cached: 9157116 kB' 'SwapCached: 0 kB' 'Active: 6503592 kB' 'Inactive: 3422668 kB' 'Active(anon): 5952936 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 759468 kB' 'Mapped: 144632 kB' 'Shmem: 5196728 kB' 'KReclaimable: 207272 kB' 'Slab: 609772 kB' 'SReclaimable: 207272 kB' 'SUnreclaim: 402500 kB' 'KernelStack: 22448 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8210484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214776 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.027 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.027 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.028 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.028 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:08.029 00:38:15 -- setup/common.sh@33 -- # echo 1024 00:04:08.029 00:38:15 -- setup/common.sh@33 -- # return 0 00:04:08.029 00:38:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:08.029 00:38:15 -- setup/hugepages.sh@112 -- # get_nodes 00:04:08.029 00:38:15 -- setup/hugepages.sh@27 -- # local node 00:04:08.029 00:38:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:08.029 00:38:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:08.029 00:38:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:08.029 00:38:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:08.029 00:38:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:08.029 00:38:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:08.029 00:38:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:08.029 00:38:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:08.029 00:38:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:08.029 00:38:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:08.029 00:38:15 -- setup/common.sh@18 -- # local node=0 00:04:08.029 00:38:15 -- setup/common.sh@19 -- # local var val 00:04:08.029 00:38:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.029 00:38:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.029 00:38:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:08.029 00:38:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:08.029 00:38:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.029 00:38:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 27910532 kB' 'MemUsed: 4671424 kB' 'SwapCached: 0 kB' 'Active: 2024932 kB' 'Inactive: 195176 kB' 'Active(anon): 1831508 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1623028 kB' 'Mapped: 45836 kB' 'AnonPages: 600192 kB' 'Shmem: 1234428 kB' 'KernelStack: 13048 kB' 'PageTables: 5836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97448 kB' 'Slab: 320528 kB' 'SReclaimable: 97448 kB' 'SUnreclaim: 223080 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.029 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.029 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@33 -- # echo 0 00:04:08.030 00:38:15 -- setup/common.sh@33 -- # return 0 00:04:08.030 00:38:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:08.030 00:38:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:08.030 00:38:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:08.030 00:38:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:08.030 00:38:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:08.030 00:38:15 -- setup/common.sh@18 -- # local node=1 00:04:08.030 00:38:15 -- setup/common.sh@19 -- # local var val 00:04:08.030 00:38:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:08.030 00:38:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:08.030 00:38:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:08.030 00:38:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:08.030 00:38:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:08.030 00:38:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60733216 kB' 'MemFree: 51239960 kB' 'MemUsed: 9493256 kB' 'SwapCached: 0 kB' 'Active: 4478636 kB' 'Inactive: 3227492 kB' 'Active(anon): 4121404 kB' 'Inactive(anon): 0 kB' 'Active(file): 357232 kB' 'Inactive(file): 3227492 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7547052 kB' 'Mapped: 98796 kB' 'AnonPages: 159168 kB' 'Shmem: 3962328 kB' 'KernelStack: 9384 kB' 'PageTables: 2620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 109824 kB' 'Slab: 289244 kB' 'SReclaimable: 109824 kB' 'SUnreclaim: 179420 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.030 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.030 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # continue 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:08.031 00:38:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:08.031 00:38:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:08.031 00:38:15 -- setup/common.sh@33 -- # echo 0 00:04:08.031 00:38:15 -- setup/common.sh@33 -- # return 0 00:04:08.031 00:38:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:08.031 00:38:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:08.031 00:38:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:08.031 00:38:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:08.031 00:38:15 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:08.031 node0=512 expecting 512 00:04:08.031 00:38:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:08.031 00:38:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:08.031 00:38:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:08.031 00:38:15 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:08.031 node1=512 expecting 512 00:04:08.031 00:38:15 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:08.031 00:04:08.031 real 0m4.318s 00:04:08.031 user 0m1.703s 00:04:08.031 sys 0m2.584s 00:04:08.031 00:38:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:08.031 00:38:15 -- common/autotest_common.sh@10 -- # set +x 00:04:08.031 ************************************ 00:04:08.031 END TEST even_2G_alloc 00:04:08.031 ************************************ 00:04:08.031 00:38:15 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:08.031 00:38:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:08.031 00:38:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:08.031 00:38:15 -- common/autotest_common.sh@10 -- # set +x 00:04:08.291 ************************************ 00:04:08.291 START TEST odd_alloc 00:04:08.291 ************************************ 00:04:08.291 00:38:15 -- common/autotest_common.sh@1111 -- # odd_alloc 00:04:08.291 00:38:15 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:08.291 00:38:15 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:08.291 00:38:15 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:08.291 00:38:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:08.291 00:38:15 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:08.291 00:38:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:08.291 00:38:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:08.291 00:38:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:08.291 00:38:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:08.291 00:38:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:08.291 00:38:15 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:08.291 00:38:15 -- setup/hugepages.sh@83 -- # : 513 00:04:08.291 00:38:15 -- setup/hugepages.sh@84 -- # : 1 00:04:08.291 00:38:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:08.291 00:38:15 -- setup/hugepages.sh@83 -- # : 0 00:04:08.291 00:38:15 -- setup/hugepages.sh@84 -- # : 0 00:04:08.291 00:38:15 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:08.291 00:38:15 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:08.291 00:38:15 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:08.291 00:38:15 -- setup/hugepages.sh@160 -- # setup output 00:04:08.291 00:38:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:08.291 00:38:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:10.832 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:10.832 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:11.091 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:12.476 00:38:19 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:12.476 00:38:19 -- setup/hugepages.sh@89 -- # local node 00:04:12.477 00:38:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:12.477 00:38:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:12.477 00:38:19 -- setup/hugepages.sh@92 -- # local surp 00:04:12.477 00:38:19 -- setup/hugepages.sh@93 -- # local resv 00:04:12.477 00:38:19 -- setup/hugepages.sh@94 -- # local anon 00:04:12.477 00:38:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:12.477 00:38:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:12.477 00:38:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:12.477 00:38:19 -- setup/common.sh@18 -- # local node= 00:04:12.477 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.477 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.477 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.477 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.477 00:38:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.477 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.477 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79148452 kB' 'MemAvailable: 82629448 kB' 'Buffers: 12936 kB' 'Cached: 9157228 kB' 'SwapCached: 0 kB' 'Active: 6510824 kB' 'Inactive: 3422668 kB' 'Active(anon): 5960168 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 766788 kB' 'Mapped: 144796 kB' 'Shmem: 5196840 kB' 'KReclaimable: 207304 kB' 'Slab: 610640 kB' 'SReclaimable: 207304 kB' 'SUnreclaim: 403336 kB' 'KernelStack: 22464 kB' 'PageTables: 8832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996588 kB' 'Committed_AS: 8214008 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214744 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.477 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.477 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:12.478 00:38:19 -- setup/common.sh@33 -- # echo 0 00:04:12.478 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.478 00:38:19 -- setup/hugepages.sh@97 -- # anon=0 00:04:12.478 00:38:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:12.478 00:38:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.478 00:38:19 -- setup/common.sh@18 -- # local node= 00:04:12.478 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.478 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.478 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.478 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.478 00:38:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.478 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.478 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79145680 kB' 'MemAvailable: 82626676 kB' 'Buffers: 12936 kB' 'Cached: 9157232 kB' 'SwapCached: 0 kB' 'Active: 6509808 kB' 'Inactive: 3422668 kB' 'Active(anon): 5959152 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 765712 kB' 'Mapped: 144788 kB' 'Shmem: 5196844 kB' 'KReclaimable: 207304 kB' 'Slab: 610740 kB' 'SReclaimable: 207304 kB' 'SUnreclaim: 403436 kB' 'KernelStack: 22576 kB' 'PageTables: 8768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996588 kB' 'Committed_AS: 8211116 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214696 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.478 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.478 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.479 00:38:19 -- setup/common.sh@33 -- # echo 0 00:04:12.479 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.479 00:38:19 -- setup/hugepages.sh@99 -- # surp=0 00:04:12.479 00:38:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:12.479 00:38:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:12.479 00:38:19 -- setup/common.sh@18 -- # local node= 00:04:12.479 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.479 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.479 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.479 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.479 00:38:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.479 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.479 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.479 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79145296 kB' 'MemAvailable: 82626292 kB' 'Buffers: 12936 kB' 'Cached: 9157244 kB' 'SwapCached: 0 kB' 'Active: 6509516 kB' 'Inactive: 3422668 kB' 'Active(anon): 5958860 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 765404 kB' 'Mapped: 144728 kB' 'Shmem: 5196856 kB' 'KReclaimable: 207304 kB' 'Slab: 610824 kB' 'SReclaimable: 207304 kB' 'SUnreclaim: 403520 kB' 'KernelStack: 22416 kB' 'PageTables: 8024 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996588 kB' 'Committed_AS: 8211136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214616 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.479 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.479 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.480 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.480 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:12.481 00:38:19 -- setup/common.sh@33 -- # echo 0 00:04:12.481 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.481 00:38:19 -- setup/hugepages.sh@100 -- # resv=0 00:04:12.481 00:38:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:12.481 nr_hugepages=1025 00:04:12.481 00:38:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:12.481 resv_hugepages=0 00:04:12.481 00:38:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:12.481 surplus_hugepages=0 00:04:12.481 00:38:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:12.481 anon_hugepages=0 00:04:12.481 00:38:19 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:12.481 00:38:19 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:12.481 00:38:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:12.481 00:38:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:12.481 00:38:19 -- setup/common.sh@18 -- # local node= 00:04:12.481 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.481 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.481 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.481 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:12.481 00:38:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:12.481 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.481 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79144448 kB' 'MemAvailable: 82625444 kB' 'Buffers: 12936 kB' 'Cached: 9157256 kB' 'SwapCached: 0 kB' 'Active: 6509548 kB' 'Inactive: 3422668 kB' 'Active(anon): 5958892 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 765372 kB' 'Mapped: 144728 kB' 'Shmem: 5196868 kB' 'KReclaimable: 207304 kB' 'Slab: 610824 kB' 'SReclaimable: 207304 kB' 'SUnreclaim: 403520 kB' 'KernelStack: 22432 kB' 'PageTables: 8340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996588 kB' 'Committed_AS: 8211284 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214616 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.481 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.481 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.482 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.482 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:12.482 00:38:19 -- setup/common.sh@33 -- # echo 1025 00:04:12.482 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.482 00:38:19 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:12.482 00:38:19 -- setup/hugepages.sh@112 -- # get_nodes 00:04:12.482 00:38:19 -- setup/hugepages.sh@27 -- # local node 00:04:12.482 00:38:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:12.482 00:38:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:12.482 00:38:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:12.482 00:38:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:12.482 00:38:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:12.482 00:38:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:12.482 00:38:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:12.482 00:38:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:12.482 00:38:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:12.483 00:38:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.483 00:38:19 -- setup/common.sh@18 -- # local node=0 00:04:12.483 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.483 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.483 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.483 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:12.483 00:38:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:12.483 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.483 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 27924136 kB' 'MemUsed: 4657820 kB' 'SwapCached: 0 kB' 'Active: 2027076 kB' 'Inactive: 195176 kB' 'Active(anon): 1833652 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1623048 kB' 'Mapped: 45876 kB' 'AnonPages: 602196 kB' 'Shmem: 1234448 kB' 'KernelStack: 12888 kB' 'PageTables: 5308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97480 kB' 'Slab: 321224 kB' 'SReclaimable: 97480 kB' 'SUnreclaim: 223744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.483 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.483 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@33 -- # echo 0 00:04:12.484 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.484 00:38:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:12.484 00:38:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:12.484 00:38:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:12.484 00:38:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:12.484 00:38:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:12.484 00:38:19 -- setup/common.sh@18 -- # local node=1 00:04:12.484 00:38:19 -- setup/common.sh@19 -- # local var val 00:04:12.484 00:38:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:12.484 00:38:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:12.484 00:38:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:12.484 00:38:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:12.484 00:38:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:12.484 00:38:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60733216 kB' 'MemFree: 51222188 kB' 'MemUsed: 9511028 kB' 'SwapCached: 0 kB' 'Active: 4482916 kB' 'Inactive: 3227492 kB' 'Active(anon): 4125684 kB' 'Inactive(anon): 0 kB' 'Active(file): 357232 kB' 'Inactive(file): 3227492 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7547188 kB' 'Mapped: 98852 kB' 'AnonPages: 163448 kB' 'Shmem: 3962464 kB' 'KernelStack: 9464 kB' 'PageTables: 2932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 109824 kB' 'Slab: 289600 kB' 'SReclaimable: 109824 kB' 'SUnreclaim: 179776 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.484 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.484 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # continue 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:12.485 00:38:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:12.485 00:38:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:12.485 00:38:19 -- setup/common.sh@33 -- # echo 0 00:04:12.485 00:38:19 -- setup/common.sh@33 -- # return 0 00:04:12.485 00:38:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:12.485 00:38:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:12.485 00:38:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:12.485 00:38:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:12.485 00:38:19 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:12.485 node0=512 expecting 513 00:04:12.485 00:38:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:12.485 00:38:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:12.485 00:38:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:12.485 00:38:19 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:12.485 node1=513 expecting 512 00:04:12.485 00:38:19 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:12.485 00:04:12.485 real 0m4.219s 00:04:12.485 user 0m1.661s 00:04:12.485 sys 0m2.603s 00:04:12.485 00:38:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:12.485 00:38:19 -- common/autotest_common.sh@10 -- # set +x 00:04:12.485 ************************************ 00:04:12.485 END TEST odd_alloc 00:04:12.485 ************************************ 00:04:12.485 00:38:19 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:12.485 00:38:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.485 00:38:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.485 00:38:19 -- common/autotest_common.sh@10 -- # set +x 00:04:12.745 ************************************ 00:04:12.745 START TEST custom_alloc 00:04:12.745 ************************************ 00:04:12.745 00:38:19 -- common/autotest_common.sh@1111 -- # custom_alloc 00:04:12.745 00:38:19 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:12.745 00:38:19 -- setup/hugepages.sh@169 -- # local node 00:04:12.745 00:38:19 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:12.745 00:38:19 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:12.745 00:38:19 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:12.745 00:38:19 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:12.745 00:38:19 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:12.745 00:38:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:12.745 00:38:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:12.745 00:38:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.745 00:38:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.745 00:38:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:12.745 00:38:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.745 00:38:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.745 00:38:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.745 00:38:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:12.745 00:38:19 -- setup/hugepages.sh@83 -- # : 256 00:04:12.745 00:38:19 -- setup/hugepages.sh@84 -- # : 1 00:04:12.745 00:38:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:12.745 00:38:19 -- setup/hugepages.sh@83 -- # : 0 00:04:12.745 00:38:19 -- setup/hugepages.sh@84 -- # : 0 00:04:12.745 00:38:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:12.745 00:38:19 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:12.745 00:38:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:12.745 00:38:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:12.745 00:38:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:12.745 00:38:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.745 00:38:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.745 00:38:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:12.745 00:38:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.745 00:38:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.745 00:38:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.745 00:38:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:12.745 00:38:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.745 00:38:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:12.745 00:38:19 -- setup/hugepages.sh@78 -- # return 0 00:04:12.745 00:38:19 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:12.745 00:38:19 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:12.745 00:38:19 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:12.746 00:38:19 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:12.746 00:38:19 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:12.746 00:38:19 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:12.746 00:38:19 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:12.746 00:38:19 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:12.746 00:38:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:12.746 00:38:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:12.746 00:38:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:12.746 00:38:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:12.746 00:38:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:12.746 00:38:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:12.746 00:38:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:12.746 00:38:19 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:12.746 00:38:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.746 00:38:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:12.746 00:38:19 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:12.746 00:38:19 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:12.746 00:38:19 -- setup/hugepages.sh@78 -- # return 0 00:04:12.746 00:38:19 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:12.746 00:38:19 -- setup/hugepages.sh@187 -- # setup output 00:04:12.746 00:38:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:12.746 00:38:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:15.314 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:15.314 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:16.694 00:38:23 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:16.694 00:38:23 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:16.694 00:38:23 -- setup/hugepages.sh@89 -- # local node 00:04:16.694 00:38:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:16.694 00:38:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:16.694 00:38:23 -- setup/hugepages.sh@92 -- # local surp 00:04:16.694 00:38:23 -- setup/hugepages.sh@93 -- # local resv 00:04:16.694 00:38:23 -- setup/hugepages.sh@94 -- # local anon 00:04:16.694 00:38:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:16.694 00:38:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:16.694 00:38:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:16.694 00:38:23 -- setup/common.sh@18 -- # local node= 00:04:16.694 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.694 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.694 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.694 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.694 00:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.694 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.694 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 78093148 kB' 'MemAvailable: 81574200 kB' 'Buffers: 12936 kB' 'Cached: 9157384 kB' 'SwapCached: 0 kB' 'Active: 6513880 kB' 'Inactive: 3422668 kB' 'Active(anon): 5963224 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 769440 kB' 'Mapped: 144840 kB' 'Shmem: 5196996 kB' 'KReclaimable: 207416 kB' 'Slab: 610044 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 402628 kB' 'KernelStack: 22512 kB' 'PageTables: 8668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473324 kB' 'Committed_AS: 8212264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214824 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.694 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.694 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:16.695 00:38:23 -- setup/common.sh@33 -- # echo 0 00:04:16.695 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.695 00:38:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:16.695 00:38:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:16.695 00:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:16.695 00:38:23 -- setup/common.sh@18 -- # local node= 00:04:16.695 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.695 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.695 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.695 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.695 00:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.695 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.695 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.695 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.695 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 78094632 kB' 'MemAvailable: 81575684 kB' 'Buffers: 12936 kB' 'Cached: 9157388 kB' 'SwapCached: 0 kB' 'Active: 6513108 kB' 'Inactive: 3422668 kB' 'Active(anon): 5962452 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 768676 kB' 'Mapped: 144752 kB' 'Shmem: 5197000 kB' 'KReclaimable: 207416 kB' 'Slab: 609976 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 402560 kB' 'KernelStack: 22352 kB' 'PageTables: 7908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473324 kB' 'Committed_AS: 8212276 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214776 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.695 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.696 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.696 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.697 00:38:23 -- setup/common.sh@33 -- # echo 0 00:04:16.697 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.697 00:38:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:16.697 00:38:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:16.697 00:38:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:16.697 00:38:23 -- setup/common.sh@18 -- # local node= 00:04:16.697 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.697 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.697 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.697 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.697 00:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.697 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.697 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 78096112 kB' 'MemAvailable: 81577164 kB' 'Buffers: 12936 kB' 'Cached: 9157388 kB' 'SwapCached: 0 kB' 'Active: 6512964 kB' 'Inactive: 3422668 kB' 'Active(anon): 5962308 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 768476 kB' 'Mapped: 144752 kB' 'Shmem: 5197000 kB' 'KReclaimable: 207416 kB' 'Slab: 609976 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 402560 kB' 'KernelStack: 22368 kB' 'PageTables: 7624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473324 kB' 'Committed_AS: 8212292 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214760 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.697 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.697 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.698 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.698 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:16.698 00:38:23 -- setup/common.sh@33 -- # echo 0 00:04:16.698 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.698 00:38:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:16.698 00:38:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:16.698 nr_hugepages=1536 00:04:16.698 00:38:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:16.698 resv_hugepages=0 00:04:16.698 00:38:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:16.698 surplus_hugepages=0 00:04:16.698 00:38:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:16.698 anon_hugepages=0 00:04:16.698 00:38:23 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:16.698 00:38:23 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:16.698 00:38:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:16.698 00:38:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:16.698 00:38:23 -- setup/common.sh@18 -- # local node= 00:04:16.698 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.698 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.698 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.698 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.698 00:38:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.699 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.699 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.699 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 78094936 kB' 'MemAvailable: 81575988 kB' 'Buffers: 12936 kB' 'Cached: 9157412 kB' 'SwapCached: 0 kB' 'Active: 6512988 kB' 'Inactive: 3422668 kB' 'Active(anon): 5962332 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 768996 kB' 'Mapped: 144752 kB' 'Shmem: 5197024 kB' 'KReclaimable: 207416 kB' 'Slab: 609976 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 402560 kB' 'KernelStack: 22416 kB' 'PageTables: 8440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53473324 kB' 'Committed_AS: 8212308 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214808 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.699 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.699 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.961 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.961 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.962 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.962 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:16.963 00:38:23 -- setup/common.sh@33 -- # echo 1536 00:04:16.963 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.963 00:38:23 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:16.963 00:38:23 -- setup/hugepages.sh@112 -- # get_nodes 00:04:16.963 00:38:23 -- setup/hugepages.sh@27 -- # local node 00:04:16.963 00:38:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:16.963 00:38:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:16.963 00:38:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:16.963 00:38:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:16.963 00:38:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:16.963 00:38:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:16.963 00:38:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:16.963 00:38:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:16.963 00:38:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:16.963 00:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:16.963 00:38:23 -- setup/common.sh@18 -- # local node=0 00:04:16.963 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.963 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.963 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.963 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:16.963 00:38:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:16.963 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.963 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 27920692 kB' 'MemUsed: 4661264 kB' 'SwapCached: 0 kB' 'Active: 2031128 kB' 'Inactive: 195176 kB' 'Active(anon): 1837704 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1623060 kB' 'Mapped: 45836 kB' 'AnonPages: 606416 kB' 'Shmem: 1234460 kB' 'KernelStack: 12984 kB' 'PageTables: 5436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97672 kB' 'Slab: 320616 kB' 'SReclaimable: 97672 kB' 'SUnreclaim: 222944 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.963 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.963 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@33 -- # echo 0 00:04:16.964 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.964 00:38:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:16.964 00:38:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:16.964 00:38:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:16.964 00:38:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:16.964 00:38:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:16.964 00:38:23 -- setup/common.sh@18 -- # local node=1 00:04:16.964 00:38:23 -- setup/common.sh@19 -- # local var val 00:04:16.964 00:38:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.964 00:38:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.964 00:38:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:16.964 00:38:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:16.964 00:38:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.964 00:38:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60733216 kB' 'MemFree: 50177924 kB' 'MemUsed: 10555292 kB' 'SwapCached: 0 kB' 'Active: 4482264 kB' 'Inactive: 3227492 kB' 'Active(anon): 4125032 kB' 'Inactive(anon): 0 kB' 'Active(file): 357232 kB' 'Inactive(file): 3227492 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7547304 kB' 'Mapped: 98916 kB' 'AnonPages: 163048 kB' 'Shmem: 3962580 kB' 'KernelStack: 9400 kB' 'PageTables: 2612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 109744 kB' 'Slab: 289340 kB' 'SReclaimable: 109744 kB' 'SUnreclaim: 179596 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.964 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.964 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # continue 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.965 00:38:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.965 00:38:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:16.965 00:38:23 -- setup/common.sh@33 -- # echo 0 00:04:16.965 00:38:23 -- setup/common.sh@33 -- # return 0 00:04:16.965 00:38:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:16.965 00:38:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:16.965 00:38:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:16.965 00:38:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:16.965 00:38:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:16.965 node0=512 expecting 512 00:04:16.965 00:38:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:16.965 00:38:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:16.965 00:38:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:16.965 00:38:23 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:16.965 node1=1024 expecting 1024 00:04:16.965 00:38:23 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:16.965 00:04:16.965 real 0m4.246s 00:04:16.965 user 0m1.592s 00:04:16.966 sys 0m2.673s 00:04:16.966 00:38:23 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:16.966 00:38:23 -- common/autotest_common.sh@10 -- # set +x 00:04:16.966 ************************************ 00:04:16.966 END TEST custom_alloc 00:04:16.966 ************************************ 00:04:16.966 00:38:23 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:16.966 00:38:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.966 00:38:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.966 00:38:23 -- common/autotest_common.sh@10 -- # set +x 00:04:16.966 ************************************ 00:04:16.966 START TEST no_shrink_alloc 00:04:16.966 ************************************ 00:04:16.966 00:38:24 -- common/autotest_common.sh@1111 -- # no_shrink_alloc 00:04:16.966 00:38:24 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:16.966 00:38:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:16.966 00:38:24 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:16.966 00:38:24 -- setup/hugepages.sh@51 -- # shift 00:04:16.966 00:38:24 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:16.966 00:38:24 -- setup/hugepages.sh@52 -- # local node_ids 00:04:16.966 00:38:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:16.966 00:38:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:16.966 00:38:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:16.966 00:38:24 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:16.966 00:38:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:16.966 00:38:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:16.966 00:38:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:16.966 00:38:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:16.966 00:38:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:16.966 00:38:24 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:16.966 00:38:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:16.966 00:38:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:16.966 00:38:24 -- setup/hugepages.sh@73 -- # return 0 00:04:16.966 00:38:24 -- setup/hugepages.sh@198 -- # setup output 00:04:16.966 00:38:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:16.966 00:38:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:20.265 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:20.265 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:21.209 00:38:28 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:21.209 00:38:28 -- setup/hugepages.sh@89 -- # local node 00:04:21.209 00:38:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:21.209 00:38:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:21.209 00:38:28 -- setup/hugepages.sh@92 -- # local surp 00:04:21.209 00:38:28 -- setup/hugepages.sh@93 -- # local resv 00:04:21.209 00:38:28 -- setup/hugepages.sh@94 -- # local anon 00:04:21.209 00:38:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:21.209 00:38:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:21.209 00:38:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:21.209 00:38:28 -- setup/common.sh@18 -- # local node= 00:04:21.209 00:38:28 -- setup/common.sh@19 -- # local var val 00:04:21.209 00:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.209 00:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.209 00:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.209 00:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.209 00:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.209 00:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79163744 kB' 'MemAvailable: 82644796 kB' 'Buffers: 12936 kB' 'Cached: 9157540 kB' 'SwapCached: 0 kB' 'Active: 6518880 kB' 'Inactive: 3422668 kB' 'Active(anon): 5968224 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 774352 kB' 'Mapped: 144932 kB' 'Shmem: 5197152 kB' 'KReclaimable: 207416 kB' 'Slab: 609300 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 401884 kB' 'KernelStack: 22560 kB' 'PageTables: 8564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8211828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214776 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.209 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.209 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.210 00:38:28 -- setup/common.sh@33 -- # echo 0 00:04:21.210 00:38:28 -- setup/common.sh@33 -- # return 0 00:04:21.210 00:38:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:21.210 00:38:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:21.210 00:38:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.210 00:38:28 -- setup/common.sh@18 -- # local node= 00:04:21.210 00:38:28 -- setup/common.sh@19 -- # local var val 00:04:21.210 00:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.210 00:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.210 00:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.210 00:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.210 00:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.210 00:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79163856 kB' 'MemAvailable: 82644908 kB' 'Buffers: 12936 kB' 'Cached: 9157544 kB' 'SwapCached: 0 kB' 'Active: 6518104 kB' 'Inactive: 3422668 kB' 'Active(anon): 5967448 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 773608 kB' 'Mapped: 144812 kB' 'Shmem: 5197156 kB' 'KReclaimable: 207416 kB' 'Slab: 609308 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 401892 kB' 'KernelStack: 22288 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8213460 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214648 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.210 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.210 00:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.211 00:38:28 -- setup/common.sh@33 -- # echo 0 00:04:21.211 00:38:28 -- setup/common.sh@33 -- # return 0 00:04:21.211 00:38:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:21.211 00:38:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:21.211 00:38:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:21.211 00:38:28 -- setup/common.sh@18 -- # local node= 00:04:21.211 00:38:28 -- setup/common.sh@19 -- # local var val 00:04:21.211 00:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.211 00:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.211 00:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.211 00:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.211 00:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.211 00:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.211 00:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79164540 kB' 'MemAvailable: 82645592 kB' 'Buffers: 12936 kB' 'Cached: 9157556 kB' 'SwapCached: 0 kB' 'Active: 6518148 kB' 'Inactive: 3422668 kB' 'Active(anon): 5967492 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 773616 kB' 'Mapped: 144812 kB' 'Shmem: 5197168 kB' 'KReclaimable: 207416 kB' 'Slab: 609308 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 401892 kB' 'KernelStack: 22336 kB' 'PageTables: 8616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8213476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214840 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.211 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.211 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.212 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.212 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.213 00:38:28 -- setup/common.sh@33 -- # echo 0 00:04:21.213 00:38:28 -- setup/common.sh@33 -- # return 0 00:04:21.213 00:38:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:21.213 00:38:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:21.213 nr_hugepages=1024 00:04:21.213 00:38:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:21.213 resv_hugepages=0 00:04:21.213 00:38:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:21.213 surplus_hugepages=0 00:04:21.213 00:38:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:21.213 anon_hugepages=0 00:04:21.213 00:38:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.213 00:38:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:21.213 00:38:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:21.213 00:38:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:21.213 00:38:28 -- setup/common.sh@18 -- # local node= 00:04:21.213 00:38:28 -- setup/common.sh@19 -- # local var val 00:04:21.213 00:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.213 00:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.213 00:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.213 00:38:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.213 00:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.213 00:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79161668 kB' 'MemAvailable: 82642720 kB' 'Buffers: 12936 kB' 'Cached: 9157572 kB' 'SwapCached: 0 kB' 'Active: 6518732 kB' 'Inactive: 3422668 kB' 'Active(anon): 5968076 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 774124 kB' 'Mapped: 144812 kB' 'Shmem: 5197184 kB' 'KReclaimable: 207416 kB' 'Slab: 609244 kB' 'SReclaimable: 207416 kB' 'SUnreclaim: 401828 kB' 'KernelStack: 22432 kB' 'PageTables: 8380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8213492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214760 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.213 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.213 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.214 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.214 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.214 00:38:28 -- setup/common.sh@33 -- # echo 1024 00:04:21.214 00:38:28 -- setup/common.sh@33 -- # return 0 00:04:21.214 00:38:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.214 00:38:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:21.214 00:38:28 -- setup/hugepages.sh@27 -- # local node 00:04:21.214 00:38:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.214 00:38:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:21.214 00:38:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.214 00:38:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:21.214 00:38:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:21.214 00:38:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:21.214 00:38:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.214 00:38:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.214 00:38:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:21.214 00:38:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.215 00:38:28 -- setup/common.sh@18 -- # local node=0 00:04:21.215 00:38:28 -- setup/common.sh@19 -- # local var val 00:04:21.215 00:38:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.215 00:38:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.215 00:38:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:21.215 00:38:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:21.215 00:38:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.215 00:38:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 26873504 kB' 'MemUsed: 5708452 kB' 'SwapCached: 0 kB' 'Active: 2034612 kB' 'Inactive: 195176 kB' 'Active(anon): 1841188 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1623084 kB' 'Mapped: 45836 kB' 'AnonPages: 609760 kB' 'Shmem: 1234484 kB' 'KernelStack: 12872 kB' 'PageTables: 5356 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97704 kB' 'Slab: 320644 kB' 'SReclaimable: 97704 kB' 'SUnreclaim: 222940 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.215 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.215 00:38:28 -- setup/common.sh@32 -- # continue 00:04:21.216 00:38:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.216 00:38:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.216 00:38:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.216 00:38:28 -- setup/common.sh@33 -- # echo 0 00:04:21.216 00:38:28 -- setup/common.sh@33 -- # return 0 00:04:21.216 00:38:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.216 00:38:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.216 00:38:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.216 00:38:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.216 00:38:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:21.216 node0=1024 expecting 1024 00:04:21.216 00:38:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:21.216 00:38:28 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:21.216 00:38:28 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:21.216 00:38:28 -- setup/hugepages.sh@202 -- # setup output 00:04:21.216 00:38:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.216 00:38:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:24.507 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:04:24.507 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:04:24.508 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:04:24.508 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:04:24.508 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:25.447 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:25.447 00:38:32 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:25.447 00:38:32 -- setup/hugepages.sh@89 -- # local node 00:04:25.447 00:38:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:25.447 00:38:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:25.447 00:38:32 -- setup/hugepages.sh@92 -- # local surp 00:04:25.447 00:38:32 -- setup/hugepages.sh@93 -- # local resv 00:04:25.447 00:38:32 -- setup/hugepages.sh@94 -- # local anon 00:04:25.447 00:38:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:25.447 00:38:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:25.447 00:38:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:25.447 00:38:32 -- setup/common.sh@18 -- # local node= 00:04:25.447 00:38:32 -- setup/common.sh@19 -- # local var val 00:04:25.447 00:38:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.447 00:38:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.447 00:38:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.447 00:38:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.447 00:38:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.447 00:38:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79151232 kB' 'MemAvailable: 82632380 kB' 'Buffers: 12936 kB' 'Cached: 9157676 kB' 'SwapCached: 0 kB' 'Active: 6523184 kB' 'Inactive: 3422668 kB' 'Active(anon): 5972528 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 778624 kB' 'Mapped: 144860 kB' 'Shmem: 5197288 kB' 'KReclaimable: 207608 kB' 'Slab: 608992 kB' 'SReclaimable: 207608 kB' 'SUnreclaim: 401384 kB' 'KernelStack: 22384 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8212740 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214600 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.447 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.447 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.448 00:38:32 -- setup/common.sh@33 -- # echo 0 00:04:25.448 00:38:32 -- setup/common.sh@33 -- # return 0 00:04:25.448 00:38:32 -- setup/hugepages.sh@97 -- # anon=0 00:04:25.448 00:38:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:25.448 00:38:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.448 00:38:32 -- setup/common.sh@18 -- # local node= 00:04:25.448 00:38:32 -- setup/common.sh@19 -- # local var val 00:04:25.448 00:38:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.448 00:38:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.448 00:38:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.448 00:38:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.448 00:38:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.448 00:38:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79150052 kB' 'MemAvailable: 82631200 kB' 'Buffers: 12936 kB' 'Cached: 9157676 kB' 'SwapCached: 0 kB' 'Active: 6525520 kB' 'Inactive: 3422668 kB' 'Active(anon): 5974864 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 780748 kB' 'Mapped: 145364 kB' 'Shmem: 5197288 kB' 'KReclaimable: 207608 kB' 'Slab: 608992 kB' 'SReclaimable: 207608 kB' 'SUnreclaim: 401384 kB' 'KernelStack: 22416 kB' 'PageTables: 8612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8216880 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214616 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.448 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.448 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.449 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.449 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.450 00:38:32 -- setup/common.sh@33 -- # echo 0 00:04:25.450 00:38:32 -- setup/common.sh@33 -- # return 0 00:04:25.450 00:38:32 -- setup/hugepages.sh@99 -- # surp=0 00:04:25.450 00:38:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:25.450 00:38:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:25.450 00:38:32 -- setup/common.sh@18 -- # local node= 00:04:25.450 00:38:32 -- setup/common.sh@19 -- # local var val 00:04:25.450 00:38:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.450 00:38:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.450 00:38:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.450 00:38:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.450 00:38:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.450 00:38:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79144048 kB' 'MemAvailable: 82625196 kB' 'Buffers: 12936 kB' 'Cached: 9157696 kB' 'SwapCached: 0 kB' 'Active: 6528812 kB' 'Inactive: 3422668 kB' 'Active(anon): 5978156 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 784144 kB' 'Mapped: 145364 kB' 'Shmem: 5197308 kB' 'KReclaimable: 207608 kB' 'Slab: 609048 kB' 'SReclaimable: 207608 kB' 'SUnreclaim: 401440 kB' 'KernelStack: 22416 kB' 'PageTables: 8400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8220520 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214716 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.450 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.450 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.451 00:38:32 -- setup/common.sh@33 -- # echo 0 00:04:25.451 00:38:32 -- setup/common.sh@33 -- # return 0 00:04:25.451 00:38:32 -- setup/hugepages.sh@100 -- # resv=0 00:04:25.451 00:38:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:25.451 nr_hugepages=1024 00:04:25.451 00:38:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:25.451 resv_hugepages=0 00:04:25.451 00:38:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:25.451 surplus_hugepages=0 00:04:25.451 00:38:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:25.451 anon_hugepages=0 00:04:25.451 00:38:32 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.451 00:38:32 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:25.451 00:38:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:25.451 00:38:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:25.451 00:38:32 -- setup/common.sh@18 -- # local node= 00:04:25.451 00:38:32 -- setup/common.sh@19 -- # local var val 00:04:25.451 00:38:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.451 00:38:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.451 00:38:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.451 00:38:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.451 00:38:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.451 00:38:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93315172 kB' 'MemFree: 79144156 kB' 'MemAvailable: 82625304 kB' 'Buffers: 12936 kB' 'Cached: 9157696 kB' 'SwapCached: 0 kB' 'Active: 6523496 kB' 'Inactive: 3422668 kB' 'Active(anon): 5972840 kB' 'Inactive(anon): 0 kB' 'Active(file): 550656 kB' 'Inactive(file): 3422668 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 778844 kB' 'Mapped: 144860 kB' 'Shmem: 5197308 kB' 'KReclaimable: 207608 kB' 'Slab: 609048 kB' 'SReclaimable: 207608 kB' 'SUnreclaim: 401440 kB' 'KernelStack: 22560 kB' 'PageTables: 8540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53997612 kB' 'Committed_AS: 8214416 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 214712 kB' 'VmallocChunk: 0 kB' 'Percpu: 70784 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 595428 kB' 'DirectMap2M: 11663360 kB' 'DirectMap1G: 90177536 kB' 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.451 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.451 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.452 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.452 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:25.453 00:38:32 -- setup/common.sh@33 -- # echo 1024 00:04:25.453 00:38:32 -- setup/common.sh@33 -- # return 0 00:04:25.453 00:38:32 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:25.453 00:38:32 -- setup/hugepages.sh@112 -- # get_nodes 00:04:25.453 00:38:32 -- setup/hugepages.sh@27 -- # local node 00:04:25.453 00:38:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.453 00:38:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:25.453 00:38:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.453 00:38:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:25.453 00:38:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:25.453 00:38:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:25.453 00:38:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:25.453 00:38:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:25.453 00:38:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:25.453 00:38:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.453 00:38:32 -- setup/common.sh@18 -- # local node=0 00:04:25.453 00:38:32 -- setup/common.sh@19 -- # local var val 00:04:25.453 00:38:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.453 00:38:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.453 00:38:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:25.453 00:38:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:25.453 00:38:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.453 00:38:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32581956 kB' 'MemFree: 26872364 kB' 'MemUsed: 5709592 kB' 'SwapCached: 0 kB' 'Active: 2038312 kB' 'Inactive: 195176 kB' 'Active(anon): 1844888 kB' 'Inactive(anon): 0 kB' 'Active(file): 193424 kB' 'Inactive(file): 195176 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1623096 kB' 'Mapped: 45836 kB' 'AnonPages: 613596 kB' 'Shmem: 1234496 kB' 'KernelStack: 12840 kB' 'PageTables: 5244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 97864 kB' 'Slab: 320416 kB' 'SReclaimable: 97864 kB' 'SUnreclaim: 222552 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.453 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.453 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # continue 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.454 00:38:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.454 00:38:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.454 00:38:32 -- setup/common.sh@33 -- # echo 0 00:04:25.454 00:38:32 -- setup/common.sh@33 -- # return 0 00:04:25.454 00:38:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:25.454 00:38:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:25.454 00:38:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:25.454 00:38:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:25.454 00:38:32 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:25.454 node0=1024 expecting 1024 00:04:25.454 00:38:32 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:25.454 00:04:25.454 real 0m8.361s 00:04:25.454 user 0m3.311s 00:04:25.454 sys 0m5.136s 00:04:25.454 00:38:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:25.454 00:38:32 -- common/autotest_common.sh@10 -- # set +x 00:04:25.454 ************************************ 00:04:25.454 END TEST no_shrink_alloc 00:04:25.454 ************************************ 00:04:25.454 00:38:32 -- setup/hugepages.sh@217 -- # clear_hp 00:04:25.454 00:38:32 -- setup/hugepages.sh@37 -- # local node hp 00:04:25.454 00:38:32 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.454 00:38:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.454 00:38:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.454 00:38:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.454 00:38:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.454 00:38:32 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.454 00:38:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.454 00:38:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.454 00:38:32 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.454 00:38:32 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.454 00:38:32 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:25.454 00:38:32 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:25.454 00:04:25.454 real 0m34.269s 00:04:25.454 user 0m12.075s 00:04:25.454 sys 0m18.996s 00:04:25.454 00:38:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:25.454 00:38:32 -- common/autotest_common.sh@10 -- # set +x 00:04:25.454 ************************************ 00:04:25.454 END TEST hugepages 00:04:25.454 ************************************ 00:04:25.454 00:38:32 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:04:25.454 00:38:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:25.454 00:38:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:25.454 00:38:32 -- common/autotest_common.sh@10 -- # set +x 00:04:25.713 ************************************ 00:04:25.713 START TEST driver 00:04:25.713 ************************************ 00:04:25.713 00:38:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:04:25.713 * Looking for test storage... 00:04:25.713 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:25.713 00:38:32 -- setup/driver.sh@68 -- # setup reset 00:04:25.713 00:38:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:25.713 00:38:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.993 00:38:38 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:30.993 00:38:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.993 00:38:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.993 00:38:38 -- common/autotest_common.sh@10 -- # set +x 00:04:31.254 ************************************ 00:04:31.254 START TEST guess_driver 00:04:31.254 ************************************ 00:04:31.254 00:38:38 -- common/autotest_common.sh@1111 -- # guess_driver 00:04:31.254 00:38:38 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:31.254 00:38:38 -- setup/driver.sh@47 -- # local fail=0 00:04:31.254 00:38:38 -- setup/driver.sh@49 -- # pick_driver 00:04:31.254 00:38:38 -- setup/driver.sh@36 -- # vfio 00:04:31.254 00:38:38 -- setup/driver.sh@21 -- # local iommu_grups 00:04:31.254 00:38:38 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:31.254 00:38:38 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:31.254 00:38:38 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:31.254 00:38:38 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:31.254 00:38:38 -- setup/driver.sh@29 -- # (( 181 > 0 )) 00:04:31.254 00:38:38 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:31.254 00:38:38 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:31.254 00:38:38 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:31.254 00:38:38 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:31.254 00:38:38 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:31.254 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:31.254 00:38:38 -- setup/driver.sh@30 -- # return 0 00:04:31.254 00:38:38 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:31.254 00:38:38 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:31.254 00:38:38 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:31.254 00:38:38 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:31.254 Looking for driver=vfio-pci 00:04:31.254 00:38:38 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.254 00:38:38 -- setup/driver.sh@45 -- # setup output config 00:04:31.254 00:38:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.254 00:38:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.549 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.549 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.549 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.550 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.550 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.550 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.550 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.550 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.550 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.550 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.550 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.550 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.550 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.550 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:34.550 00:38:41 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:34.550 00:38:41 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:34.550 00:38:41 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:37.842 00:38:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:37.843 00:38:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:37.843 00:38:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:38.780 00:38:45 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:38.780 00:38:45 -- setup/driver.sh@65 -- # setup reset 00:04:38.780 00:38:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:38.780 00:38:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:44.076 00:04:44.076 real 0m12.864s 00:04:44.076 user 0m3.206s 00:04:44.076 sys 0m5.598s 00:04:44.076 00:38:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:44.076 00:38:51 -- common/autotest_common.sh@10 -- # set +x 00:04:44.076 ************************************ 00:04:44.076 END TEST guess_driver 00:04:44.076 ************************************ 00:04:44.076 00:04:44.076 real 0m18.413s 00:04:44.076 user 0m4.885s 00:04:44.076 sys 0m8.608s 00:04:44.076 00:38:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:04:44.076 00:38:51 -- common/autotest_common.sh@10 -- # set +x 00:04:44.076 ************************************ 00:04:44.076 END TEST driver 00:04:44.076 ************************************ 00:04:44.076 00:38:51 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:04:44.076 00:38:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.076 00:38:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.076 00:38:51 -- common/autotest_common.sh@10 -- # set +x 00:04:44.337 ************************************ 00:04:44.337 START TEST devices 00:04:44.337 ************************************ 00:04:44.337 00:38:51 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:04:44.337 * Looking for test storage... 00:04:44.337 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:04:44.337 00:38:51 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:44.337 00:38:51 -- setup/devices.sh@192 -- # setup reset 00:04:44.337 00:38:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:44.337 00:38:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:48.539 00:38:55 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:48.539 00:38:55 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:48.539 00:38:55 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:48.539 00:38:55 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:48.539 00:38:55 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:48.539 00:38:55 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:48.539 00:38:55 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:48.539 00:38:55 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:48.539 00:38:55 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:48.539 00:38:55 -- setup/devices.sh@196 -- # blocks=() 00:04:48.539 00:38:55 -- setup/devices.sh@196 -- # declare -a blocks 00:04:48.539 00:38:55 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:48.539 00:38:55 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:48.539 00:38:55 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:48.539 00:38:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:48.539 00:38:55 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:48.539 00:38:55 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:48.539 00:38:55 -- setup/devices.sh@202 -- # pci=0000:d8:00.0 00:04:48.539 00:38:55 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\d\8\:\0\0\.\0* ]] 00:04:48.539 00:38:55 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:48.539 00:38:55 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:04:48.539 00:38:55 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:48.799 No valid GPT data, bailing 00:04:48.799 00:38:55 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:48.799 00:38:55 -- scripts/common.sh@391 -- # pt= 00:04:48.799 00:38:55 -- scripts/common.sh@392 -- # return 1 00:04:48.799 00:38:55 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:48.799 00:38:55 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:48.799 00:38:55 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:48.799 00:38:55 -- setup/common.sh@80 -- # echo 4000787030016 00:04:48.799 00:38:55 -- setup/devices.sh@204 -- # (( 4000787030016 >= min_disk_size )) 00:04:48.799 00:38:55 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:48.799 00:38:55 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:d8:00.0 00:04:48.799 00:38:55 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:48.799 00:38:55 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:48.799 00:38:55 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:48.799 00:38:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.799 00:38:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.799 00:38:55 -- common/autotest_common.sh@10 -- # set +x 00:04:48.799 ************************************ 00:04:48.799 START TEST nvme_mount 00:04:48.799 ************************************ 00:04:48.799 00:38:55 -- common/autotest_common.sh@1111 -- # nvme_mount 00:04:48.799 00:38:55 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:48.799 00:38:55 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:48.799 00:38:55 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:48.799 00:38:55 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:48.799 00:38:55 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:48.799 00:38:55 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:48.799 00:38:55 -- setup/common.sh@40 -- # local part_no=1 00:04:48.799 00:38:55 -- setup/common.sh@41 -- # local size=1073741824 00:04:48.799 00:38:55 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:48.799 00:38:55 -- setup/common.sh@44 -- # parts=() 00:04:48.799 00:38:55 -- setup/common.sh@44 -- # local parts 00:04:48.799 00:38:55 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:48.799 00:38:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.799 00:38:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:48.799 00:38:55 -- setup/common.sh@46 -- # (( part++ )) 00:04:48.799 00:38:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:48.799 00:38:55 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:48.799 00:38:55 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:48.799 00:38:55 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:49.737 Creating new GPT entries in memory. 00:04:49.737 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:49.737 other utilities. 00:04:49.737 00:38:56 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:49.737 00:38:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:49.737 00:38:56 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:49.737 00:38:56 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:49.737 00:38:56 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:51.118 Creating new GPT entries in memory. 00:04:51.118 The operation has completed successfully. 00:04:51.118 00:38:57 -- setup/common.sh@57 -- # (( part++ )) 00:04:51.118 00:38:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:51.118 00:38:57 -- setup/common.sh@62 -- # wait 107933 00:04:51.118 00:38:57 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.118 00:38:57 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:51.118 00:38:57 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.118 00:38:57 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:51.118 00:38:57 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:51.118 00:38:58 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.118 00:38:58 -- setup/devices.sh@105 -- # verify 0000:d8:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:51.118 00:38:58 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:51.118 00:38:58 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:51.118 00:38:58 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.118 00:38:58 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:51.118 00:38:58 -- setup/devices.sh@53 -- # local found=0 00:04:51.118 00:38:58 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:51.118 00:38:58 -- setup/devices.sh@56 -- # : 00:04:51.118 00:38:58 -- setup/devices.sh@59 -- # local pci status 00:04:51.118 00:38:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.118 00:38:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:51.118 00:38:58 -- setup/devices.sh@47 -- # setup output config 00:04:51.118 00:38:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.118 00:38:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:53.659 00:39:00 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:53.659 00:39:00 -- setup/devices.sh@63 -- # found=1 00:04:53.659 00:39:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.040 00:39:02 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:55.040 00:39:02 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:55.040 00:39:02 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.040 00:39:02 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:55.040 00:39:02 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:55.040 00:39:02 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:55.040 00:39:02 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.040 00:39:02 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.040 00:39:02 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:55.040 00:39:02 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:55.040 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:55.040 00:39:02 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:55.040 00:39:02 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:55.299 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:55.299 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:55.299 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:55.299 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:55.299 00:39:02 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:55.299 00:39:02 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:55.299 00:39:02 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.299 00:39:02 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:55.299 00:39:02 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:55.299 00:39:02 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.299 00:39:02 -- setup/devices.sh@116 -- # verify 0000:d8:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:55.299 00:39:02 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:55.299 00:39:02 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:55.299 00:39:02 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:55.300 00:39:02 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:55.300 00:39:02 -- setup/devices.sh@53 -- # local found=0 00:04:55.300 00:39:02 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:55.300 00:39:02 -- setup/devices.sh@56 -- # : 00:04:55.300 00:39:02 -- setup/devices.sh@59 -- # local pci status 00:04:55.300 00:39:02 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:55.300 00:39:02 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:55.300 00:39:02 -- setup/devices.sh@47 -- # setup output config 00:04:55.300 00:39:02 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:55.300 00:39:02 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:04:58.594 00:39:05 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:58.594 00:39:05 -- setup/devices.sh@63 -- # found=1 00:04:58.594 00:39:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.532 00:39:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:59.532 00:39:06 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:59.532 00:39:06 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.532 00:39:06 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:59.532 00:39:06 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:59.533 00:39:06 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.533 00:39:06 -- setup/devices.sh@125 -- # verify 0000:d8:00.0 data@nvme0n1 '' '' 00:04:59.533 00:39:06 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:04:59.533 00:39:06 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:59.533 00:39:06 -- setup/devices.sh@50 -- # local mount_point= 00:04:59.533 00:39:06 -- setup/devices.sh@51 -- # local test_file= 00:04:59.533 00:39:06 -- setup/devices.sh@53 -- # local found=0 00:04:59.533 00:39:06 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:59.533 00:39:06 -- setup/devices.sh@59 -- # local pci status 00:04:59.533 00:39:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.533 00:39:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:04:59.533 00:39:06 -- setup/devices.sh@47 -- # setup output config 00:04:59.533 00:39:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:59.533 00:39:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:02.075 00:39:09 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:02.075 00:39:09 -- setup/devices.sh@63 -- # found=1 00:05:02.075 00:39:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.456 00:39:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:03.456 00:39:10 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:03.456 00:39:10 -- setup/devices.sh@68 -- # return 0 00:05:03.456 00:39:10 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:03.456 00:39:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.456 00:39:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:03.456 00:39:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:03.456 00:39:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:03.456 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:03.456 00:05:03.456 real 0m14.736s 00:05:03.456 user 0m4.499s 00:05:03.456 sys 0m7.897s 00:05:03.456 00:39:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:03.456 00:39:10 -- common/autotest_common.sh@10 -- # set +x 00:05:03.456 ************************************ 00:05:03.456 END TEST nvme_mount 00:05:03.456 ************************************ 00:05:03.715 00:39:10 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:03.715 00:39:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:03.715 00:39:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:03.715 00:39:10 -- common/autotest_common.sh@10 -- # set +x 00:05:03.715 ************************************ 00:05:03.715 START TEST dm_mount 00:05:03.715 ************************************ 00:05:03.715 00:39:10 -- common/autotest_common.sh@1111 -- # dm_mount 00:05:03.715 00:39:10 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:03.715 00:39:10 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:03.715 00:39:10 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:03.715 00:39:10 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:03.715 00:39:10 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:03.715 00:39:10 -- setup/common.sh@40 -- # local part_no=2 00:05:03.715 00:39:10 -- setup/common.sh@41 -- # local size=1073741824 00:05:03.715 00:39:10 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:03.715 00:39:10 -- setup/common.sh@44 -- # parts=() 00:05:03.715 00:39:10 -- setup/common.sh@44 -- # local parts 00:05:03.715 00:39:10 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:03.716 00:39:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:03.716 00:39:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:03.716 00:39:10 -- setup/common.sh@46 -- # (( part++ )) 00:05:03.716 00:39:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:03.716 00:39:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:03.716 00:39:10 -- setup/common.sh@46 -- # (( part++ )) 00:05:03.716 00:39:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:03.716 00:39:10 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:03.716 00:39:10 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:03.716 00:39:10 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:04.656 Creating new GPT entries in memory. 00:05:04.656 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:04.656 other utilities. 00:05:04.656 00:39:11 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:04.656 00:39:11 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:04.656 00:39:11 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:04.656 00:39:11 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:04.656 00:39:11 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:06.037 Creating new GPT entries in memory. 00:05:06.037 The operation has completed successfully. 00:05:06.037 00:39:12 -- setup/common.sh@57 -- # (( part++ )) 00:05:06.037 00:39:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.037 00:39:12 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.037 00:39:12 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.037 00:39:12 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:06.975 The operation has completed successfully. 00:05:06.975 00:39:13 -- setup/common.sh@57 -- # (( part++ )) 00:05:06.976 00:39:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.976 00:39:13 -- setup/common.sh@62 -- # wait 113721 00:05:06.976 00:39:13 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:06.976 00:39:13 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:06.976 00:39:13 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.976 00:39:13 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:06.976 00:39:13 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:06.976 00:39:13 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.976 00:39:13 -- setup/devices.sh@161 -- # break 00:05:06.976 00:39:13 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.976 00:39:13 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:06.976 00:39:13 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:06.976 00:39:13 -- setup/devices.sh@166 -- # dm=dm-0 00:05:06.976 00:39:13 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:06.976 00:39:13 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:06.976 00:39:13 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:06.976 00:39:13 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:05:06.976 00:39:13 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:06.976 00:39:13 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:06.976 00:39:13 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:06.976 00:39:13 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:06.976 00:39:14 -- setup/devices.sh@174 -- # verify 0000:d8:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.976 00:39:14 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:05:06.976 00:39:14 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:06.976 00:39:14 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:06.976 00:39:14 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:06.976 00:39:14 -- setup/devices.sh@53 -- # local found=0 00:05:06.976 00:39:14 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:06.976 00:39:14 -- setup/devices.sh@56 -- # : 00:05:06.976 00:39:14 -- setup/devices.sh@59 -- # local pci status 00:05:06.976 00:39:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.976 00:39:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:05:06.976 00:39:14 -- setup/devices.sh@47 -- # setup output config 00:05:06.976 00:39:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:06.976 00:39:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:09.516 00:39:16 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:09.516 00:39:16 -- setup/devices.sh@63 -- # found=1 00:05:09.516 00:39:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.897 00:39:17 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.897 00:39:17 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:10.897 00:39:17 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:10.897 00:39:17 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:10.897 00:39:17 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:10.897 00:39:17 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:10.897 00:39:18 -- setup/devices.sh@184 -- # verify 0000:d8:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:10.897 00:39:18 -- setup/devices.sh@48 -- # local dev=0000:d8:00.0 00:05:10.897 00:39:18 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:10.897 00:39:18 -- setup/devices.sh@50 -- # local mount_point= 00:05:10.897 00:39:18 -- setup/devices.sh@51 -- # local test_file= 00:05:10.897 00:39:18 -- setup/devices.sh@53 -- # local found=0 00:05:10.897 00:39:18 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:10.897 00:39:18 -- setup/devices.sh@59 -- # local pci status 00:05:10.897 00:39:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.897 00:39:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:d8:00.0 00:05:10.897 00:39:18 -- setup/devices.sh@47 -- # setup output config 00:05:10.897 00:39:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.897 00:39:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.437 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.437 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.438 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.438 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:13.697 00:39:20 -- setup/devices.sh@62 -- # [[ 0000:d8:00.0 == \0\0\0\0\:\d\8\:\0\0\.\0 ]] 00:05:13.697 00:39:20 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:13.697 00:39:20 -- setup/devices.sh@63 -- # found=1 00:05:13.697 00:39:20 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.076 00:39:22 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:15.076 00:39:22 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:15.076 00:39:22 -- setup/devices.sh@68 -- # return 0 00:05:15.076 00:39:22 -- setup/devices.sh@187 -- # cleanup_dm 00:05:15.076 00:39:22 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:15.076 00:39:22 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:15.076 00:39:22 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:15.076 00:39:22 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:15.076 00:39:22 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:15.076 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:15.076 00:39:22 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:15.076 00:39:22 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:15.076 00:05:15.076 real 0m11.293s 00:05:15.076 user 0m2.979s 00:05:15.076 sys 0m5.294s 00:05:15.076 00:39:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:15.076 00:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:15.076 ************************************ 00:05:15.076 END TEST dm_mount 00:05:15.076 ************************************ 00:05:15.076 00:39:22 -- setup/devices.sh@1 -- # cleanup 00:05:15.076 00:39:22 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:15.076 00:39:22 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:05:15.076 00:39:22 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:15.076 00:39:22 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:15.076 00:39:22 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:15.076 00:39:22 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:15.336 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:15.336 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:15.336 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:15.336 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:15.336 00:39:22 -- setup/devices.sh@12 -- # cleanup_dm 00:05:15.336 00:39:22 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:05:15.336 00:39:22 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:15.336 00:39:22 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:15.336 00:39:22 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:15.336 00:39:22 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:15.336 00:39:22 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:15.336 00:05:15.336 real 0m31.138s 00:05:15.336 user 0m9.245s 00:05:15.336 sys 0m16.353s 00:05:15.336 00:39:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:15.336 00:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:15.336 ************************************ 00:05:15.336 END TEST devices 00:05:15.336 ************************************ 00:05:15.336 00:05:15.336 real 1m53.914s 00:05:15.336 user 0m35.766s 00:05:15.336 sys 1m0.321s 00:05:15.336 00:39:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:15.336 00:39:22 -- common/autotest_common.sh@10 -- # set +x 00:05:15.336 ************************************ 00:05:15.336 END TEST setup.sh 00:05:15.336 ************************************ 00:05:15.336 00:39:22 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:05:18.627 Hugepages 00:05:18.627 node hugesize free / total 00:05:18.627 node0 1048576kB 0 / 0 00:05:18.627 node0 2048kB 2048 / 2048 00:05:18.627 node1 1048576kB 0 / 0 00:05:18.628 node1 2048kB 0 / 0 00:05:18.628 00:05:18.628 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:18.628 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:05:18.628 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:05:18.628 NVMe 0000:d8:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:18.628 00:39:25 -- spdk/autotest.sh@130 -- # uname -s 00:05:18.628 00:39:25 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:05:18.628 00:39:25 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:05:18.628 00:39:25 -- common/autotest_common.sh@1517 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:21.164 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:21.164 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:24.462 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:05:25.836 00:39:32 -- common/autotest_common.sh@1518 -- # sleep 1 00:05:26.772 00:39:33 -- common/autotest_common.sh@1519 -- # bdfs=() 00:05:26.772 00:39:33 -- common/autotest_common.sh@1519 -- # local bdfs 00:05:26.772 00:39:33 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:05:26.772 00:39:33 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:05:26.772 00:39:33 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:26.772 00:39:33 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:26.772 00:39:33 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:26.772 00:39:33 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:26.772 00:39:33 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:27.031 00:39:34 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:27.031 00:39:34 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:05:27.031 00:39:34 -- common/autotest_common.sh@1522 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:05:29.569 Waiting for block devices as requested 00:05:29.829 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:29.829 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:29.829 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:29.829 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:30.089 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:30.089 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:30.089 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:30.349 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:30.349 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:05:30.350 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:05:30.350 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:05:30.609 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:05:30.609 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:05:30.609 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:05:30.869 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:05:30.869 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:05:30.869 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:05:32.250 00:39:39 -- common/autotest_common.sh@1524 -- # for bdf in "${bdfs[@]}" 00:05:32.250 00:39:39 -- common/autotest_common.sh@1525 -- # get_nvme_ctrlr_from_bdf 0000:d8:00.0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1488 -- # readlink -f /sys/class/nvme/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1488 -- # grep 0000:d8:00.0/nvme/nvme 00:05:32.250 00:39:39 -- common/autotest_common.sh@1488 -- # bdf_sysfs_path=/sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1489 -- # [[ -z /sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 ]] 00:05:32.250 00:39:39 -- common/autotest_common.sh@1493 -- # basename /sys/devices/pci0000:d7/0000:d7:00.0/0000:d8:00.0/nvme/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1493 -- # printf '%s\n' nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1525 -- # nvme_ctrlr=/dev/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1526 -- # [[ -z /dev/nvme0 ]] 00:05:32.250 00:39:39 -- common/autotest_common.sh@1531 -- # nvme id-ctrl /dev/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1531 -- # grep oacs 00:05:32.250 00:39:39 -- common/autotest_common.sh@1531 -- # cut -d: -f2 00:05:32.250 00:39:39 -- common/autotest_common.sh@1531 -- # oacs=' 0xe' 00:05:32.250 00:39:39 -- common/autotest_common.sh@1532 -- # oacs_ns_manage=8 00:05:32.250 00:39:39 -- common/autotest_common.sh@1534 -- # [[ 8 -ne 0 ]] 00:05:32.250 00:39:39 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:32.250 00:39:39 -- common/autotest_common.sh@1540 -- # grep unvmcap 00:05:32.250 00:39:39 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:32.250 00:39:39 -- common/autotest_common.sh@1540 -- # unvmcap=' 0' 00:05:32.250 00:39:39 -- common/autotest_common.sh@1541 -- # [[ 0 -eq 0 ]] 00:05:32.250 00:39:39 -- common/autotest_common.sh@1543 -- # continue 00:05:32.250 00:39:39 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:05:32.250 00:39:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:32.250 00:39:39 -- common/autotest_common.sh@10 -- # set +x 00:05:32.250 00:39:39 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:05:32.250 00:39:39 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:32.250 00:39:39 -- common/autotest_common.sh@10 -- # set +x 00:05:32.250 00:39:39 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:05:35.541 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:05:35.541 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:05:38.833 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:05:39.769 00:39:46 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:05:39.769 00:39:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:05:39.769 00:39:46 -- common/autotest_common.sh@10 -- # set +x 00:05:39.769 00:39:46 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:05:39.769 00:39:46 -- common/autotest_common.sh@1577 -- # mapfile -t bdfs 00:05:39.769 00:39:46 -- common/autotest_common.sh@1577 -- # get_nvme_bdfs_by_id 0x0a54 00:05:39.769 00:39:46 -- common/autotest_common.sh@1563 -- # bdfs=() 00:05:39.769 00:39:46 -- common/autotest_common.sh@1563 -- # local bdfs 00:05:39.769 00:39:46 -- common/autotest_common.sh@1565 -- # get_nvme_bdfs 00:05:39.769 00:39:46 -- common/autotest_common.sh@1499 -- # bdfs=() 00:05:39.769 00:39:46 -- common/autotest_common.sh@1499 -- # local bdfs 00:05:39.769 00:39:46 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:39.769 00:39:46 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:39.769 00:39:46 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:05:40.029 00:39:47 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:05:40.029 00:39:47 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:05:40.029 00:39:47 -- common/autotest_common.sh@1565 -- # for bdf in $(get_nvme_bdfs) 00:05:40.029 00:39:47 -- common/autotest_common.sh@1566 -- # cat /sys/bus/pci/devices/0000:d8:00.0/device 00:05:40.029 00:39:47 -- common/autotest_common.sh@1566 -- # device=0x0a54 00:05:40.029 00:39:47 -- common/autotest_common.sh@1567 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:40.029 00:39:47 -- common/autotest_common.sh@1568 -- # bdfs+=($bdf) 00:05:40.029 00:39:47 -- common/autotest_common.sh@1572 -- # printf '%s\n' 0000:d8:00.0 00:05:40.029 00:39:47 -- common/autotest_common.sh@1578 -- # [[ -z 0000:d8:00.0 ]] 00:05:40.029 00:39:47 -- common/autotest_common.sh@1583 -- # spdk_tgt_pid=124515 00:05:40.029 00:39:47 -- common/autotest_common.sh@1584 -- # waitforlisten 124515 00:05:40.029 00:39:47 -- common/autotest_common.sh@1582 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:40.029 00:39:47 -- common/autotest_common.sh@817 -- # '[' -z 124515 ']' 00:05:40.029 00:39:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.029 00:39:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:40.029 00:39:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.029 00:39:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:40.029 00:39:47 -- common/autotest_common.sh@10 -- # set +x 00:05:40.029 [2024-04-26 00:39:47.092094] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:05:40.029 [2024-04-26 00:39:47.092143] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid124515 ] 00:05:40.029 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.029 [2024-04-26 00:39:47.160696] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.287 [2024-04-26 00:39:47.229896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.856 00:39:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:40.856 00:39:47 -- common/autotest_common.sh@850 -- # return 0 00:05:40.856 00:39:47 -- common/autotest_common.sh@1586 -- # bdf_id=0 00:05:40.856 00:39:47 -- common/autotest_common.sh@1587 -- # for bdf in "${bdfs[@]}" 00:05:40.856 00:39:47 -- common/autotest_common.sh@1588 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:d8:00.0 00:05:44.148 nvme0n1 00:05:44.148 00:39:50 -- common/autotest_common.sh@1590 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:44.148 [2024-04-26 00:39:50.958151] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:05:44.148 request: 00:05:44.148 { 00:05:44.148 "nvme_ctrlr_name": "nvme0", 00:05:44.148 "password": "test", 00:05:44.148 "method": "bdev_nvme_opal_revert", 00:05:44.148 "req_id": 1 00:05:44.148 } 00:05:44.148 Got JSON-RPC error response 00:05:44.148 response: 00:05:44.148 { 00:05:44.148 "code": -32602, 00:05:44.148 "message": "Invalid parameters" 00:05:44.148 } 00:05:44.148 00:39:50 -- common/autotest_common.sh@1590 -- # true 00:05:44.148 00:39:50 -- common/autotest_common.sh@1591 -- # (( ++bdf_id )) 00:05:44.148 00:39:50 -- common/autotest_common.sh@1594 -- # killprocess 124515 00:05:44.148 00:39:50 -- common/autotest_common.sh@936 -- # '[' -z 124515 ']' 00:05:44.148 00:39:50 -- common/autotest_common.sh@940 -- # kill -0 124515 00:05:44.148 00:39:50 -- common/autotest_common.sh@941 -- # uname 00:05:44.148 00:39:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:44.148 00:39:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 124515 00:05:44.148 00:39:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:44.148 00:39:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:44.148 00:39:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 124515' 00:05:44.148 killing process with pid 124515 00:05:44.148 00:39:51 -- common/autotest_common.sh@955 -- # kill 124515 00:05:44.148 00:39:51 -- common/autotest_common.sh@960 -- # wait 124515 00:05:48.341 00:39:54 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:05:48.341 00:39:54 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:05:48.341 00:39:54 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:48.341 00:39:54 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:05:48.341 00:39:54 -- spdk/autotest.sh@162 -- # timing_enter lib 00:05:48.341 00:39:54 -- common/autotest_common.sh@710 -- # xtrace_disable 00:05:48.341 00:39:54 -- common/autotest_common.sh@10 -- # set +x 00:05:48.341 00:39:54 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:05:48.341 00:39:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.341 00:39:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.341 00:39:54 -- common/autotest_common.sh@10 -- # set +x 00:05:48.341 ************************************ 00:05:48.341 START TEST env 00:05:48.341 ************************************ 00:05:48.341 00:39:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:05:48.341 * Looking for test storage... 00:05:48.341 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:05:48.341 00:39:55 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:05:48.341 00:39:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.341 00:39:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.341 00:39:55 -- common/autotest_common.sh@10 -- # set +x 00:05:48.341 ************************************ 00:05:48.341 START TEST env_memory 00:05:48.341 ************************************ 00:05:48.341 00:39:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:05:48.341 00:05:48.341 00:05:48.341 CUnit - A unit testing framework for C - Version 2.1-3 00:05:48.341 http://cunit.sourceforge.net/ 00:05:48.341 00:05:48.341 00:05:48.341 Suite: memory 00:05:48.341 Test: alloc and free memory map ...[2024-04-26 00:39:55.340974] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:48.341 passed 00:05:48.341 Test: mem map translation ...[2024-04-26 00:39:55.357647] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:48.341 [2024-04-26 00:39:55.357660] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:48.341 [2024-04-26 00:39:55.357691] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:48.341 [2024-04-26 00:39:55.357697] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:48.341 passed 00:05:48.341 Test: mem map registration ...[2024-04-26 00:39:55.390850] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:48.341 [2024-04-26 00:39:55.390863] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:48.341 passed 00:05:48.341 Test: mem map adjacent registrations ...passed 00:05:48.341 00:05:48.341 Run Summary: Type Total Ran Passed Failed Inactive 00:05:48.341 suites 1 1 n/a 0 0 00:05:48.341 tests 4 4 4 0 0 00:05:48.341 asserts 152 152 152 0 n/a 00:05:48.341 00:05:48.341 Elapsed time = 0.125 seconds 00:05:48.341 00:05:48.341 real 0m0.136s 00:05:48.341 user 0m0.128s 00:05:48.341 sys 0m0.007s 00:05:48.341 00:39:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:48.341 00:39:55 -- common/autotest_common.sh@10 -- # set +x 00:05:48.341 ************************************ 00:05:48.341 END TEST env_memory 00:05:48.341 ************************************ 00:05:48.341 00:39:55 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:48.341 00:39:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:48.341 00:39:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.341 00:39:55 -- common/autotest_common.sh@10 -- # set +x 00:05:48.602 ************************************ 00:05:48.602 START TEST env_vtophys 00:05:48.602 ************************************ 00:05:48.602 00:39:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:48.602 EAL: lib.eal log level changed from notice to debug 00:05:48.602 EAL: Detected lcore 0 as core 0 on socket 0 00:05:48.602 EAL: Detected lcore 1 as core 1 on socket 0 00:05:48.602 EAL: Detected lcore 2 as core 2 on socket 0 00:05:48.602 EAL: Detected lcore 3 as core 3 on socket 0 00:05:48.602 EAL: Detected lcore 4 as core 4 on socket 0 00:05:48.602 EAL: Detected lcore 5 as core 5 on socket 0 00:05:48.602 EAL: Detected lcore 6 as core 6 on socket 0 00:05:48.602 EAL: Detected lcore 7 as core 8 on socket 0 00:05:48.602 EAL: Detected lcore 8 as core 9 on socket 0 00:05:48.602 EAL: Detected lcore 9 as core 10 on socket 0 00:05:48.602 EAL: Detected lcore 10 as core 11 on socket 0 00:05:48.602 EAL: Detected lcore 11 as core 12 on socket 0 00:05:48.602 EAL: Detected lcore 12 as core 13 on socket 0 00:05:48.602 EAL: Detected lcore 13 as core 14 on socket 0 00:05:48.602 EAL: Detected lcore 14 as core 16 on socket 0 00:05:48.602 EAL: Detected lcore 15 as core 17 on socket 0 00:05:48.602 EAL: Detected lcore 16 as core 18 on socket 0 00:05:48.602 EAL: Detected lcore 17 as core 19 on socket 0 00:05:48.602 EAL: Detected lcore 18 as core 20 on socket 0 00:05:48.602 EAL: Detected lcore 19 as core 21 on socket 0 00:05:48.602 EAL: Detected lcore 20 as core 22 on socket 0 00:05:48.602 EAL: Detected lcore 21 as core 24 on socket 0 00:05:48.602 EAL: Detected lcore 22 as core 25 on socket 0 00:05:48.602 EAL: Detected lcore 23 as core 26 on socket 0 00:05:48.602 EAL: Detected lcore 24 as core 27 on socket 0 00:05:48.602 EAL: Detected lcore 25 as core 28 on socket 0 00:05:48.602 EAL: Detected lcore 26 as core 29 on socket 0 00:05:48.602 EAL: Detected lcore 27 as core 30 on socket 0 00:05:48.602 EAL: Detected lcore 28 as core 0 on socket 1 00:05:48.602 EAL: Detected lcore 29 as core 1 on socket 1 00:05:48.602 EAL: Detected lcore 30 as core 2 on socket 1 00:05:48.602 EAL: Detected lcore 31 as core 3 on socket 1 00:05:48.602 EAL: Detected lcore 32 as core 4 on socket 1 00:05:48.602 EAL: Detected lcore 33 as core 5 on socket 1 00:05:48.602 EAL: Detected lcore 34 as core 6 on socket 1 00:05:48.602 EAL: Detected lcore 35 as core 8 on socket 1 00:05:48.602 EAL: Detected lcore 36 as core 9 on socket 1 00:05:48.602 EAL: Detected lcore 37 as core 10 on socket 1 00:05:48.602 EAL: Detected lcore 38 as core 11 on socket 1 00:05:48.602 EAL: Detected lcore 39 as core 12 on socket 1 00:05:48.602 EAL: Detected lcore 40 as core 13 on socket 1 00:05:48.602 EAL: Detected lcore 41 as core 14 on socket 1 00:05:48.602 EAL: Detected lcore 42 as core 16 on socket 1 00:05:48.602 EAL: Detected lcore 43 as core 17 on socket 1 00:05:48.602 EAL: Detected lcore 44 as core 18 on socket 1 00:05:48.602 EAL: Detected lcore 45 as core 19 on socket 1 00:05:48.602 EAL: Detected lcore 46 as core 20 on socket 1 00:05:48.602 EAL: Detected lcore 47 as core 21 on socket 1 00:05:48.602 EAL: Detected lcore 48 as core 22 on socket 1 00:05:48.602 EAL: Detected lcore 49 as core 24 on socket 1 00:05:48.602 EAL: Detected lcore 50 as core 25 on socket 1 00:05:48.602 EAL: Detected lcore 51 as core 26 on socket 1 00:05:48.602 EAL: Detected lcore 52 as core 27 on socket 1 00:05:48.603 EAL: Detected lcore 53 as core 28 on socket 1 00:05:48.603 EAL: Detected lcore 54 as core 29 on socket 1 00:05:48.603 EAL: Detected lcore 55 as core 30 on socket 1 00:05:48.603 EAL: Detected lcore 56 as core 0 on socket 0 00:05:48.603 EAL: Detected lcore 57 as core 1 on socket 0 00:05:48.603 EAL: Detected lcore 58 as core 2 on socket 0 00:05:48.603 EAL: Detected lcore 59 as core 3 on socket 0 00:05:48.603 EAL: Detected lcore 60 as core 4 on socket 0 00:05:48.603 EAL: Detected lcore 61 as core 5 on socket 0 00:05:48.603 EAL: Detected lcore 62 as core 6 on socket 0 00:05:48.603 EAL: Detected lcore 63 as core 8 on socket 0 00:05:48.603 EAL: Detected lcore 64 as core 9 on socket 0 00:05:48.603 EAL: Detected lcore 65 as core 10 on socket 0 00:05:48.603 EAL: Detected lcore 66 as core 11 on socket 0 00:05:48.603 EAL: Detected lcore 67 as core 12 on socket 0 00:05:48.603 EAL: Detected lcore 68 as core 13 on socket 0 00:05:48.603 EAL: Detected lcore 69 as core 14 on socket 0 00:05:48.603 EAL: Detected lcore 70 as core 16 on socket 0 00:05:48.603 EAL: Detected lcore 71 as core 17 on socket 0 00:05:48.603 EAL: Detected lcore 72 as core 18 on socket 0 00:05:48.603 EAL: Detected lcore 73 as core 19 on socket 0 00:05:48.603 EAL: Detected lcore 74 as core 20 on socket 0 00:05:48.603 EAL: Detected lcore 75 as core 21 on socket 0 00:05:48.603 EAL: Detected lcore 76 as core 22 on socket 0 00:05:48.603 EAL: Detected lcore 77 as core 24 on socket 0 00:05:48.603 EAL: Detected lcore 78 as core 25 on socket 0 00:05:48.603 EAL: Detected lcore 79 as core 26 on socket 0 00:05:48.603 EAL: Detected lcore 80 as core 27 on socket 0 00:05:48.603 EAL: Detected lcore 81 as core 28 on socket 0 00:05:48.603 EAL: Detected lcore 82 as core 29 on socket 0 00:05:48.603 EAL: Detected lcore 83 as core 30 on socket 0 00:05:48.603 EAL: Detected lcore 84 as core 0 on socket 1 00:05:48.603 EAL: Detected lcore 85 as core 1 on socket 1 00:05:48.603 EAL: Detected lcore 86 as core 2 on socket 1 00:05:48.603 EAL: Detected lcore 87 as core 3 on socket 1 00:05:48.603 EAL: Detected lcore 88 as core 4 on socket 1 00:05:48.603 EAL: Detected lcore 89 as core 5 on socket 1 00:05:48.603 EAL: Detected lcore 90 as core 6 on socket 1 00:05:48.603 EAL: Detected lcore 91 as core 8 on socket 1 00:05:48.603 EAL: Detected lcore 92 as core 9 on socket 1 00:05:48.603 EAL: Detected lcore 93 as core 10 on socket 1 00:05:48.603 EAL: Detected lcore 94 as core 11 on socket 1 00:05:48.603 EAL: Detected lcore 95 as core 12 on socket 1 00:05:48.603 EAL: Detected lcore 96 as core 13 on socket 1 00:05:48.603 EAL: Detected lcore 97 as core 14 on socket 1 00:05:48.603 EAL: Detected lcore 98 as core 16 on socket 1 00:05:48.603 EAL: Detected lcore 99 as core 17 on socket 1 00:05:48.603 EAL: Detected lcore 100 as core 18 on socket 1 00:05:48.603 EAL: Detected lcore 101 as core 19 on socket 1 00:05:48.603 EAL: Detected lcore 102 as core 20 on socket 1 00:05:48.603 EAL: Detected lcore 103 as core 21 on socket 1 00:05:48.603 EAL: Detected lcore 104 as core 22 on socket 1 00:05:48.603 EAL: Detected lcore 105 as core 24 on socket 1 00:05:48.603 EAL: Detected lcore 106 as core 25 on socket 1 00:05:48.603 EAL: Detected lcore 107 as core 26 on socket 1 00:05:48.603 EAL: Detected lcore 108 as core 27 on socket 1 00:05:48.603 EAL: Detected lcore 109 as core 28 on socket 1 00:05:48.603 EAL: Detected lcore 110 as core 29 on socket 1 00:05:48.603 EAL: Detected lcore 111 as core 30 on socket 1 00:05:48.603 EAL: Maximum logical cores by configuration: 128 00:05:48.603 EAL: Detected CPU lcores: 112 00:05:48.603 EAL: Detected NUMA nodes: 2 00:05:48.603 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:48.603 EAL: Detected shared linkage of DPDK 00:05:48.603 EAL: No shared files mode enabled, IPC will be disabled 00:05:48.603 EAL: Bus pci wants IOVA as 'DC' 00:05:48.603 EAL: Buses did not request a specific IOVA mode. 00:05:48.603 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:48.603 EAL: Selected IOVA mode 'VA' 00:05:48.603 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.603 EAL: Probing VFIO support... 00:05:48.603 EAL: IOMMU type 1 (Type 1) is supported 00:05:48.603 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:48.603 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:48.603 EAL: VFIO support initialized 00:05:48.603 EAL: Ask a virtual area of 0x2e000 bytes 00:05:48.603 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:48.603 EAL: Setting up physically contiguous memory... 00:05:48.603 EAL: Setting maximum number of open files to 524288 00:05:48.603 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:48.603 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:48.603 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:48.603 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:48.603 EAL: Ask a virtual area of 0x61000 bytes 00:05:48.603 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:48.603 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:48.603 EAL: Ask a virtual area of 0x400000000 bytes 00:05:48.603 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:48.603 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:48.603 EAL: Hugepages will be freed exactly as allocated. 00:05:48.603 EAL: No shared files mode enabled, IPC is disabled 00:05:48.603 EAL: No shared files mode enabled, IPC is disabled 00:05:48.603 EAL: TSC frequency is ~2700000 KHz 00:05:48.603 EAL: Main lcore 0 is ready (tid=7f0e5053ea00;cpuset=[0]) 00:05:48.603 EAL: Trying to obtain current memory policy. 00:05:48.603 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.603 EAL: Restoring previous memory policy: 0 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 2MB 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:48.604 EAL: Mem event callback 'spdk:(nil)' registered 00:05:48.604 00:05:48.604 00:05:48.604 CUnit - A unit testing framework for C - Version 2.1-3 00:05:48.604 http://cunit.sourceforge.net/ 00:05:48.604 00:05:48.604 00:05:48.604 Suite: components_suite 00:05:48.604 Test: vtophys_malloc_test ...passed 00:05:48.604 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 4MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 4MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 6MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 6MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 10MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 10MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 18MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 18MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 34MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 34MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 66MB 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was shrunk by 66MB 00:05:48.604 EAL: Trying to obtain current memory policy. 00:05:48.604 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.604 EAL: Restoring previous memory policy: 4 00:05:48.604 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.604 EAL: request: mp_malloc_sync 00:05:48.604 EAL: No shared files mode enabled, IPC is disabled 00:05:48.604 EAL: Heap on socket 0 was expanded by 130MB 00:05:48.864 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.864 EAL: request: mp_malloc_sync 00:05:48.864 EAL: No shared files mode enabled, IPC is disabled 00:05:48.864 EAL: Heap on socket 0 was shrunk by 130MB 00:05:48.864 EAL: Trying to obtain current memory policy. 00:05:48.864 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.864 EAL: Restoring previous memory policy: 4 00:05:48.864 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.864 EAL: request: mp_malloc_sync 00:05:48.864 EAL: No shared files mode enabled, IPC is disabled 00:05:48.864 EAL: Heap on socket 0 was expanded by 258MB 00:05:48.864 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.864 EAL: request: mp_malloc_sync 00:05:48.864 EAL: No shared files mode enabled, IPC is disabled 00:05:48.864 EAL: Heap on socket 0 was shrunk by 258MB 00:05:48.864 EAL: Trying to obtain current memory policy. 00:05:48.864 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:48.864 EAL: Restoring previous memory policy: 4 00:05:48.864 EAL: Calling mem event callback 'spdk:(nil)' 00:05:48.864 EAL: request: mp_malloc_sync 00:05:48.864 EAL: No shared files mode enabled, IPC is disabled 00:05:48.864 EAL: Heap on socket 0 was expanded by 514MB 00:05:49.123 EAL: Calling mem event callback 'spdk:(nil)' 00:05:49.123 EAL: request: mp_malloc_sync 00:05:49.123 EAL: No shared files mode enabled, IPC is disabled 00:05:49.123 EAL: Heap on socket 0 was shrunk by 514MB 00:05:49.123 EAL: Trying to obtain current memory policy. 00:05:49.123 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:49.382 EAL: Restoring previous memory policy: 4 00:05:49.382 EAL: Calling mem event callback 'spdk:(nil)' 00:05:49.382 EAL: request: mp_malloc_sync 00:05:49.382 EAL: No shared files mode enabled, IPC is disabled 00:05:49.382 EAL: Heap on socket 0 was expanded by 1026MB 00:05:49.382 EAL: Calling mem event callback 'spdk:(nil)' 00:05:49.642 EAL: request: mp_malloc_sync 00:05:49.642 EAL: No shared files mode enabled, IPC is disabled 00:05:49.642 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:49.642 passed 00:05:49.642 00:05:49.642 Run Summary: Type Total Ran Passed Failed Inactive 00:05:49.642 suites 1 1 n/a 0 0 00:05:49.642 tests 2 2 2 0 0 00:05:49.642 asserts 497 497 497 0 n/a 00:05:49.642 00:05:49.642 Elapsed time = 0.962 seconds 00:05:49.642 EAL: Calling mem event callback 'spdk:(nil)' 00:05:49.642 EAL: request: mp_malloc_sync 00:05:49.642 EAL: No shared files mode enabled, IPC is disabled 00:05:49.642 EAL: Heap on socket 0 was shrunk by 2MB 00:05:49.642 EAL: No shared files mode enabled, IPC is disabled 00:05:49.642 EAL: No shared files mode enabled, IPC is disabled 00:05:49.642 EAL: No shared files mode enabled, IPC is disabled 00:05:49.642 00:05:49.642 real 0m1.082s 00:05:49.642 user 0m0.643s 00:05:49.642 sys 0m0.418s 00:05:49.642 00:39:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.642 00:39:56 -- common/autotest_common.sh@10 -- # set +x 00:05:49.642 ************************************ 00:05:49.642 END TEST env_vtophys 00:05:49.642 ************************************ 00:05:49.642 00:39:56 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:05:49.642 00:39:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:49.642 00:39:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.642 00:39:56 -- common/autotest_common.sh@10 -- # set +x 00:05:49.902 ************************************ 00:05:49.902 START TEST env_pci 00:05:49.902 ************************************ 00:05:49.902 00:39:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:05:49.902 00:05:49.902 00:05:49.902 CUnit - A unit testing framework for C - Version 2.1-3 00:05:49.902 http://cunit.sourceforge.net/ 00:05:49.902 00:05:49.902 00:05:49.902 Suite: pci 00:05:49.902 Test: pci_hook ...[2024-04-26 00:39:56.881352] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 126451 has claimed it 00:05:49.902 EAL: Cannot find device (10000:00:01.0) 00:05:49.902 EAL: Failed to attach device on primary process 00:05:49.902 passed 00:05:49.902 00:05:49.902 Run Summary: Type Total Ran Passed Failed Inactive 00:05:49.902 suites 1 1 n/a 0 0 00:05:49.902 tests 1 1 1 0 0 00:05:49.902 asserts 25 25 25 0 n/a 00:05:49.902 00:05:49.902 Elapsed time = 0.029 seconds 00:05:49.902 00:05:49.902 real 0m0.048s 00:05:49.902 user 0m0.014s 00:05:49.902 sys 0m0.033s 00:05:49.902 00:39:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:49.902 00:39:56 -- common/autotest_common.sh@10 -- # set +x 00:05:49.902 ************************************ 00:05:49.902 END TEST env_pci 00:05:49.902 ************************************ 00:05:49.902 00:39:56 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:49.902 00:39:56 -- env/env.sh@15 -- # uname 00:05:49.902 00:39:56 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:49.902 00:39:56 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:49.902 00:39:56 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:49.902 00:39:56 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:49.902 00:39:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.902 00:39:56 -- common/autotest_common.sh@10 -- # set +x 00:05:50.161 ************************************ 00:05:50.161 START TEST env_dpdk_post_init 00:05:50.161 ************************************ 00:05:50.161 00:39:57 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:50.161 EAL: Detected CPU lcores: 112 00:05:50.161 EAL: Detected NUMA nodes: 2 00:05:50.161 EAL: Detected shared linkage of DPDK 00:05:50.161 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:50.161 EAL: Selected IOVA mode 'VA' 00:05:50.161 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.161 EAL: VFIO support initialized 00:05:50.161 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:50.161 EAL: Using IOMMU type 1 (Type 1) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:05:50.161 EAL: Ignore mapping IO port bar(1) 00:05:50.161 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:05:50.162 EAL: Ignore mapping IO port bar(1) 00:05:50.162 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:05:50.421 EAL: Ignore mapping IO port bar(1) 00:05:50.421 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:05:50.421 EAL: Ignore mapping IO port bar(1) 00:05:50.421 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:05:50.421 EAL: Ignore mapping IO port bar(1) 00:05:50.421 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:05:50.421 EAL: Ignore mapping IO port bar(1) 00:05:50.421 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:05:50.421 EAL: Ignore mapping IO port bar(1) 00:05:50.421 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:05:50.990 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:d8:00.0 (socket 1) 00:05:56.266 EAL: Releasing PCI mapped resource for 0000:d8:00.0 00:05:56.266 EAL: Calling pci_unmap_resource for 0000:d8:00.0 at 0x202001040000 00:05:56.836 Starting DPDK initialization... 00:05:56.836 Starting SPDK post initialization... 00:05:56.836 SPDK NVMe probe 00:05:56.836 Attaching to 0000:d8:00.0 00:05:56.836 Attached to 0000:d8:00.0 00:05:56.836 Cleaning up... 00:05:56.836 00:05:56.836 real 0m6.634s 00:05:56.836 user 0m5.486s 00:05:56.836 sys 0m0.219s 00:05:56.836 00:40:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.836 00:40:03 -- common/autotest_common.sh@10 -- # set +x 00:05:56.836 ************************************ 00:05:56.836 END TEST env_dpdk_post_init 00:05:56.836 ************************************ 00:05:56.836 00:40:03 -- env/env.sh@26 -- # uname 00:05:56.836 00:40:03 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:56.836 00:40:03 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.836 00:40:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.836 00:40:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.836 00:40:03 -- common/autotest_common.sh@10 -- # set +x 00:05:56.836 ************************************ 00:05:56.836 START TEST env_mem_callbacks 00:05:56.836 ************************************ 00:05:56.836 00:40:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:56.836 EAL: Detected CPU lcores: 112 00:05:56.836 EAL: Detected NUMA nodes: 2 00:05:56.836 EAL: Detected shared linkage of DPDK 00:05:56.836 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:56.836 EAL: Selected IOVA mode 'VA' 00:05:56.836 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.836 EAL: VFIO support initialized 00:05:56.836 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:56.836 00:05:56.836 00:05:56.836 CUnit - A unit testing framework for C - Version 2.1-3 00:05:56.836 http://cunit.sourceforge.net/ 00:05:56.836 00:05:56.836 00:05:56.836 Suite: memory 00:05:56.836 Test: test ... 00:05:56.836 register 0x200000200000 2097152 00:05:56.836 malloc 3145728 00:05:56.836 register 0x200000400000 4194304 00:05:56.836 buf 0x200000500000 len 3145728 PASSED 00:05:56.836 malloc 64 00:05:56.836 buf 0x2000004fff40 len 64 PASSED 00:05:56.836 malloc 4194304 00:05:56.836 register 0x200000800000 6291456 00:05:56.836 buf 0x200000a00000 len 4194304 PASSED 00:05:56.836 free 0x200000500000 3145728 00:05:56.836 free 0x2000004fff40 64 00:05:56.836 unregister 0x200000400000 4194304 PASSED 00:05:56.836 free 0x200000a00000 4194304 00:05:56.836 unregister 0x200000800000 6291456 PASSED 00:05:56.836 malloc 8388608 00:05:56.836 register 0x200000400000 10485760 00:05:56.836 buf 0x200000600000 len 8388608 PASSED 00:05:56.836 free 0x200000600000 8388608 00:05:56.836 unregister 0x200000400000 10485760 PASSED 00:05:56.836 passed 00:05:56.836 00:05:56.836 Run Summary: Type Total Ran Passed Failed Inactive 00:05:56.836 suites 1 1 n/a 0 0 00:05:56.836 tests 1 1 1 0 0 00:05:56.836 asserts 15 15 15 0 n/a 00:05:56.836 00:05:56.836 Elapsed time = 0.009 seconds 00:05:56.836 00:05:56.836 real 0m0.061s 00:05:56.836 user 0m0.024s 00:05:56.836 sys 0m0.036s 00:05:56.836 00:40:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.836 00:40:03 -- common/autotest_common.sh@10 -- # set +x 00:05:56.836 ************************************ 00:05:56.836 END TEST env_mem_callbacks 00:05:56.836 ************************************ 00:05:56.836 00:05:56.836 real 0m8.924s 00:05:56.836 user 0m6.664s 00:05:56.836 sys 0m1.255s 00:05:56.836 00:40:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:56.836 00:40:04 -- common/autotest_common.sh@10 -- # set +x 00:05:56.836 ************************************ 00:05:56.836 END TEST env 00:05:56.836 ************************************ 00:05:57.096 00:40:04 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:05:57.096 00:40:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.096 00:40:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.096 00:40:04 -- common/autotest_common.sh@10 -- # set +x 00:05:57.096 ************************************ 00:05:57.096 START TEST rpc 00:05:57.096 ************************************ 00:05:57.096 00:40:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:05:57.096 * Looking for test storage... 00:05:57.096 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:57.096 00:40:04 -- rpc/rpc.sh@65 -- # spdk_pid=127974 00:05:57.096 00:40:04 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:57.096 00:40:04 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:57.096 00:40:04 -- rpc/rpc.sh@67 -- # waitforlisten 127974 00:05:57.096 00:40:04 -- common/autotest_common.sh@817 -- # '[' -z 127974 ']' 00:05:57.096 00:40:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:57.096 00:40:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:05:57.096 00:40:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:57.096 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:57.096 00:40:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:05:57.096 00:40:04 -- common/autotest_common.sh@10 -- # set +x 00:05:57.356 [2024-04-26 00:40:04.324544] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:05:57.356 [2024-04-26 00:40:04.324595] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid127974 ] 00:05:57.356 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.356 [2024-04-26 00:40:04.389343] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.356 [2024-04-26 00:40:04.454258] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:57.356 [2024-04-26 00:40:04.454298] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 127974' to capture a snapshot of events at runtime. 00:05:57.356 [2024-04-26 00:40:04.454303] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:57.356 [2024-04-26 00:40:04.454309] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:57.356 [2024-04-26 00:40:04.454313] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid127974 for offline analysis/debug. 00:05:57.356 [2024-04-26 00:40:04.454345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.925 00:40:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:05:57.925 00:40:05 -- common/autotest_common.sh@850 -- # return 0 00:05:57.925 00:40:05 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:57.925 00:40:05 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:05:57.925 00:40:05 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:57.925 00:40:05 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:57.925 00:40:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.925 00:40:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.925 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.183 ************************************ 00:05:58.183 START TEST rpc_integrity 00:05:58.184 ************************************ 00:05:58.184 00:40:05 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:58.184 00:40:05 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:58.184 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.184 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.184 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.184 00:40:05 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:58.184 00:40:05 -- rpc/rpc.sh@13 -- # jq length 00:05:58.184 00:40:05 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:58.184 00:40:05 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:58.184 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.184 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.184 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.184 00:40:05 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:58.184 00:40:05 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:58.184 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.184 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.184 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.184 00:40:05 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:58.184 { 00:05:58.184 "name": "Malloc0", 00:05:58.184 "aliases": [ 00:05:58.184 "933deeb1-f7e4-4a16-bdc7-3ff9add1679b" 00:05:58.184 ], 00:05:58.184 "product_name": "Malloc disk", 00:05:58.184 "block_size": 512, 00:05:58.184 "num_blocks": 16384, 00:05:58.184 "uuid": "933deeb1-f7e4-4a16-bdc7-3ff9add1679b", 00:05:58.184 "assigned_rate_limits": { 00:05:58.184 "rw_ios_per_sec": 0, 00:05:58.184 "rw_mbytes_per_sec": 0, 00:05:58.184 "r_mbytes_per_sec": 0, 00:05:58.184 "w_mbytes_per_sec": 0 00:05:58.184 }, 00:05:58.184 "claimed": false, 00:05:58.184 "zoned": false, 00:05:58.184 "supported_io_types": { 00:05:58.184 "read": true, 00:05:58.184 "write": true, 00:05:58.184 "unmap": true, 00:05:58.184 "write_zeroes": true, 00:05:58.184 "flush": true, 00:05:58.184 "reset": true, 00:05:58.184 "compare": false, 00:05:58.184 "compare_and_write": false, 00:05:58.184 "abort": true, 00:05:58.184 "nvme_admin": false, 00:05:58.184 "nvme_io": false 00:05:58.184 }, 00:05:58.184 "memory_domains": [ 00:05:58.184 { 00:05:58.184 "dma_device_id": "system", 00:05:58.184 "dma_device_type": 1 00:05:58.184 }, 00:05:58.184 { 00:05:58.184 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.184 "dma_device_type": 2 00:05:58.184 } 00:05:58.184 ], 00:05:58.184 "driver_specific": {} 00:05:58.184 } 00:05:58.184 ]' 00:05:58.184 00:40:05 -- rpc/rpc.sh@17 -- # jq length 00:05:58.184 00:40:05 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:58.184 00:40:05 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:58.184 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.184 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.184 [2024-04-26 00:40:05.371029] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:58.184 [2024-04-26 00:40:05.371056] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:58.184 [2024-04-26 00:40:05.371067] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x16e6760 00:05:58.184 [2024-04-26 00:40:05.371072] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:58.184 [2024-04-26 00:40:05.372060] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:58.184 [2024-04-26 00:40:05.372079] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:58.184 Passthru0 00:05:58.184 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.442 00:40:05 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:58.442 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.442 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.442 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.442 00:40:05 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:58.442 { 00:05:58.442 "name": "Malloc0", 00:05:58.442 "aliases": [ 00:05:58.442 "933deeb1-f7e4-4a16-bdc7-3ff9add1679b" 00:05:58.442 ], 00:05:58.442 "product_name": "Malloc disk", 00:05:58.442 "block_size": 512, 00:05:58.442 "num_blocks": 16384, 00:05:58.442 "uuid": "933deeb1-f7e4-4a16-bdc7-3ff9add1679b", 00:05:58.442 "assigned_rate_limits": { 00:05:58.442 "rw_ios_per_sec": 0, 00:05:58.442 "rw_mbytes_per_sec": 0, 00:05:58.442 "r_mbytes_per_sec": 0, 00:05:58.442 "w_mbytes_per_sec": 0 00:05:58.442 }, 00:05:58.442 "claimed": true, 00:05:58.442 "claim_type": "exclusive_write", 00:05:58.442 "zoned": false, 00:05:58.442 "supported_io_types": { 00:05:58.442 "read": true, 00:05:58.442 "write": true, 00:05:58.442 "unmap": true, 00:05:58.442 "write_zeroes": true, 00:05:58.442 "flush": true, 00:05:58.442 "reset": true, 00:05:58.442 "compare": false, 00:05:58.442 "compare_and_write": false, 00:05:58.442 "abort": true, 00:05:58.442 "nvme_admin": false, 00:05:58.442 "nvme_io": false 00:05:58.442 }, 00:05:58.442 "memory_domains": [ 00:05:58.442 { 00:05:58.442 "dma_device_id": "system", 00:05:58.442 "dma_device_type": 1 00:05:58.442 }, 00:05:58.442 { 00:05:58.442 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.442 "dma_device_type": 2 00:05:58.442 } 00:05:58.442 ], 00:05:58.442 "driver_specific": {} 00:05:58.442 }, 00:05:58.442 { 00:05:58.442 "name": "Passthru0", 00:05:58.442 "aliases": [ 00:05:58.442 "91570dd5-9af5-53e3-bc72-d502ea7d8bf6" 00:05:58.442 ], 00:05:58.442 "product_name": "passthru", 00:05:58.442 "block_size": 512, 00:05:58.442 "num_blocks": 16384, 00:05:58.442 "uuid": "91570dd5-9af5-53e3-bc72-d502ea7d8bf6", 00:05:58.442 "assigned_rate_limits": { 00:05:58.442 "rw_ios_per_sec": 0, 00:05:58.442 "rw_mbytes_per_sec": 0, 00:05:58.442 "r_mbytes_per_sec": 0, 00:05:58.442 "w_mbytes_per_sec": 0 00:05:58.442 }, 00:05:58.442 "claimed": false, 00:05:58.442 "zoned": false, 00:05:58.442 "supported_io_types": { 00:05:58.442 "read": true, 00:05:58.442 "write": true, 00:05:58.442 "unmap": true, 00:05:58.442 "write_zeroes": true, 00:05:58.442 "flush": true, 00:05:58.442 "reset": true, 00:05:58.442 "compare": false, 00:05:58.442 "compare_and_write": false, 00:05:58.442 "abort": true, 00:05:58.442 "nvme_admin": false, 00:05:58.442 "nvme_io": false 00:05:58.442 }, 00:05:58.442 "memory_domains": [ 00:05:58.442 { 00:05:58.442 "dma_device_id": "system", 00:05:58.442 "dma_device_type": 1 00:05:58.442 }, 00:05:58.442 { 00:05:58.442 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.442 "dma_device_type": 2 00:05:58.442 } 00:05:58.442 ], 00:05:58.442 "driver_specific": { 00:05:58.442 "passthru": { 00:05:58.442 "name": "Passthru0", 00:05:58.442 "base_bdev_name": "Malloc0" 00:05:58.442 } 00:05:58.443 } 00:05:58.443 } 00:05:58.443 ]' 00:05:58.443 00:40:05 -- rpc/rpc.sh@21 -- # jq length 00:05:58.443 00:40:05 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:58.443 00:40:05 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:58.443 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.443 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.443 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.443 00:40:05 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:58.443 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.443 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.443 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.443 00:40:05 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:58.443 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.443 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.443 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.443 00:40:05 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:58.443 00:40:05 -- rpc/rpc.sh@26 -- # jq length 00:05:58.443 00:40:05 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:58.443 00:05:58.443 real 0m0.266s 00:05:58.443 user 0m0.165s 00:05:58.443 sys 0m0.036s 00:05:58.443 00:40:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:58.443 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.443 ************************************ 00:05:58.443 END TEST rpc_integrity 00:05:58.443 ************************************ 00:05:58.443 00:40:05 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:58.443 00:40:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.443 00:40:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.443 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 ************************************ 00:05:58.702 START TEST rpc_plugins 00:05:58.702 ************************************ 00:05:58.702 00:40:05 -- common/autotest_common.sh@1111 -- # rpc_plugins 00:05:58.702 00:40:05 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:58.702 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.702 00:40:05 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:58.702 00:40:05 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:58.702 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.702 00:40:05 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:58.702 { 00:05:58.702 "name": "Malloc1", 00:05:58.702 "aliases": [ 00:05:58.702 "64424527-d2fe-4e03-8a31-77411dfe0d2c" 00:05:58.702 ], 00:05:58.702 "product_name": "Malloc disk", 00:05:58.702 "block_size": 4096, 00:05:58.702 "num_blocks": 256, 00:05:58.702 "uuid": "64424527-d2fe-4e03-8a31-77411dfe0d2c", 00:05:58.702 "assigned_rate_limits": { 00:05:58.702 "rw_ios_per_sec": 0, 00:05:58.702 "rw_mbytes_per_sec": 0, 00:05:58.702 "r_mbytes_per_sec": 0, 00:05:58.702 "w_mbytes_per_sec": 0 00:05:58.702 }, 00:05:58.702 "claimed": false, 00:05:58.702 "zoned": false, 00:05:58.702 "supported_io_types": { 00:05:58.702 "read": true, 00:05:58.702 "write": true, 00:05:58.702 "unmap": true, 00:05:58.702 "write_zeroes": true, 00:05:58.702 "flush": true, 00:05:58.702 "reset": true, 00:05:58.702 "compare": false, 00:05:58.702 "compare_and_write": false, 00:05:58.702 "abort": true, 00:05:58.702 "nvme_admin": false, 00:05:58.702 "nvme_io": false 00:05:58.702 }, 00:05:58.702 "memory_domains": [ 00:05:58.702 { 00:05:58.702 "dma_device_id": "system", 00:05:58.702 "dma_device_type": 1 00:05:58.702 }, 00:05:58.702 { 00:05:58.702 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:58.702 "dma_device_type": 2 00:05:58.702 } 00:05:58.702 ], 00:05:58.702 "driver_specific": {} 00:05:58.702 } 00:05:58.702 ]' 00:05:58.702 00:40:05 -- rpc/rpc.sh@32 -- # jq length 00:05:58.702 00:40:05 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:58.702 00:40:05 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:58.702 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.702 00:40:05 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:58.702 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.702 00:40:05 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:58.702 00:40:05 -- rpc/rpc.sh@36 -- # jq length 00:05:58.702 00:40:05 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:58.702 00:05:58.702 real 0m0.124s 00:05:58.702 user 0m0.073s 00:05:58.702 sys 0m0.018s 00:05:58.702 00:40:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.702 ************************************ 00:05:58.702 END TEST rpc_plugins 00:05:58.702 ************************************ 00:05:58.702 00:40:05 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:58.702 00:40:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.702 00:40:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.702 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.961 ************************************ 00:05:58.961 START TEST rpc_trace_cmd_test 00:05:58.962 ************************************ 00:05:58.962 00:40:05 -- common/autotest_common.sh@1111 -- # rpc_trace_cmd_test 00:05:58.962 00:40:05 -- rpc/rpc.sh@40 -- # local info 00:05:58.962 00:40:05 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:58.962 00:40:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:58.962 00:40:05 -- common/autotest_common.sh@10 -- # set +x 00:05:58.962 00:40:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:58.962 00:40:05 -- rpc/rpc.sh@42 -- # info='{ 00:05:58.962 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid127974", 00:05:58.962 "tpoint_group_mask": "0x8", 00:05:58.962 "iscsi_conn": { 00:05:58.962 "mask": "0x2", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "scsi": { 00:05:58.962 "mask": "0x4", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "bdev": { 00:05:58.962 "mask": "0x8", 00:05:58.962 "tpoint_mask": "0xffffffffffffffff" 00:05:58.962 }, 00:05:58.962 "nvmf_rdma": { 00:05:58.962 "mask": "0x10", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "nvmf_tcp": { 00:05:58.962 "mask": "0x20", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "ftl": { 00:05:58.962 "mask": "0x40", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "blobfs": { 00:05:58.962 "mask": "0x80", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "dsa": { 00:05:58.962 "mask": "0x200", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "thread": { 00:05:58.962 "mask": "0x400", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "nvme_pcie": { 00:05:58.962 "mask": "0x800", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "iaa": { 00:05:58.962 "mask": "0x1000", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "nvme_tcp": { 00:05:58.962 "mask": "0x2000", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "bdev_nvme": { 00:05:58.962 "mask": "0x4000", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 }, 00:05:58.962 "sock": { 00:05:58.962 "mask": "0x8000", 00:05:58.962 "tpoint_mask": "0x0" 00:05:58.962 } 00:05:58.962 }' 00:05:58.962 00:40:05 -- rpc/rpc.sh@43 -- # jq length 00:05:58.962 00:40:06 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:05:58.962 00:40:06 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:58.962 00:40:06 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:58.962 00:40:06 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:58.962 00:40:06 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:58.962 00:40:06 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:58.962 00:40:06 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:58.962 00:40:06 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:58.962 00:40:06 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:58.962 00:05:58.962 real 0m0.199s 00:05:58.962 user 0m0.164s 00:05:58.962 sys 0m0.028s 00:05:58.962 00:40:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:58.962 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:58.962 ************************************ 00:05:58.962 END TEST rpc_trace_cmd_test 00:05:58.962 ************************************ 00:05:59.221 00:40:06 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:59.221 00:40:06 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:59.221 00:40:06 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:59.221 00:40:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.221 00:40:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.221 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.221 ************************************ 00:05:59.221 START TEST rpc_daemon_integrity 00:05:59.221 ************************************ 00:05:59.221 00:40:06 -- common/autotest_common.sh@1111 -- # rpc_integrity 00:05:59.221 00:40:06 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:59.221 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.221 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.222 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.222 00:40:06 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:59.222 00:40:06 -- rpc/rpc.sh@13 -- # jq length 00:05:59.222 00:40:06 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:59.222 00:40:06 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:59.222 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.222 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.222 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.222 00:40:06 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:59.222 00:40:06 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:59.222 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.222 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.222 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.222 00:40:06 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:59.222 { 00:05:59.222 "name": "Malloc2", 00:05:59.222 "aliases": [ 00:05:59.222 "fd38e6cc-f4ca-427a-9278-f6f8d17d7c7b" 00:05:59.222 ], 00:05:59.222 "product_name": "Malloc disk", 00:05:59.222 "block_size": 512, 00:05:59.222 "num_blocks": 16384, 00:05:59.222 "uuid": "fd38e6cc-f4ca-427a-9278-f6f8d17d7c7b", 00:05:59.222 "assigned_rate_limits": { 00:05:59.222 "rw_ios_per_sec": 0, 00:05:59.222 "rw_mbytes_per_sec": 0, 00:05:59.222 "r_mbytes_per_sec": 0, 00:05:59.222 "w_mbytes_per_sec": 0 00:05:59.222 }, 00:05:59.222 "claimed": false, 00:05:59.222 "zoned": false, 00:05:59.222 "supported_io_types": { 00:05:59.222 "read": true, 00:05:59.222 "write": true, 00:05:59.222 "unmap": true, 00:05:59.222 "write_zeroes": true, 00:05:59.222 "flush": true, 00:05:59.222 "reset": true, 00:05:59.222 "compare": false, 00:05:59.222 "compare_and_write": false, 00:05:59.222 "abort": true, 00:05:59.222 "nvme_admin": false, 00:05:59.222 "nvme_io": false 00:05:59.222 }, 00:05:59.222 "memory_domains": [ 00:05:59.222 { 00:05:59.222 "dma_device_id": "system", 00:05:59.222 "dma_device_type": 1 00:05:59.222 }, 00:05:59.222 { 00:05:59.222 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:59.222 "dma_device_type": 2 00:05:59.222 } 00:05:59.222 ], 00:05:59.222 "driver_specific": {} 00:05:59.222 } 00:05:59.222 ]' 00:05:59.222 00:40:06 -- rpc/rpc.sh@17 -- # jq length 00:05:59.482 00:40:06 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:59.482 00:40:06 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:59.482 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.482 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.482 [2024-04-26 00:40:06.425893] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:59.482 [2024-04-26 00:40:06.425920] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:59.482 [2024-04-26 00:40:06.425930] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x16e6c30 00:05:59.482 [2024-04-26 00:40:06.425935] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:59.482 [2024-04-26 00:40:06.426823] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:59.482 [2024-04-26 00:40:06.426842] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:59.482 Passthru0 00:05:59.482 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.482 00:40:06 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:59.482 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.482 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.482 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.482 00:40:06 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:59.482 { 00:05:59.482 "name": "Malloc2", 00:05:59.482 "aliases": [ 00:05:59.482 "fd38e6cc-f4ca-427a-9278-f6f8d17d7c7b" 00:05:59.482 ], 00:05:59.482 "product_name": "Malloc disk", 00:05:59.482 "block_size": 512, 00:05:59.482 "num_blocks": 16384, 00:05:59.482 "uuid": "fd38e6cc-f4ca-427a-9278-f6f8d17d7c7b", 00:05:59.482 "assigned_rate_limits": { 00:05:59.482 "rw_ios_per_sec": 0, 00:05:59.482 "rw_mbytes_per_sec": 0, 00:05:59.482 "r_mbytes_per_sec": 0, 00:05:59.482 "w_mbytes_per_sec": 0 00:05:59.482 }, 00:05:59.482 "claimed": true, 00:05:59.482 "claim_type": "exclusive_write", 00:05:59.482 "zoned": false, 00:05:59.482 "supported_io_types": { 00:05:59.482 "read": true, 00:05:59.482 "write": true, 00:05:59.482 "unmap": true, 00:05:59.482 "write_zeroes": true, 00:05:59.482 "flush": true, 00:05:59.482 "reset": true, 00:05:59.482 "compare": false, 00:05:59.482 "compare_and_write": false, 00:05:59.482 "abort": true, 00:05:59.482 "nvme_admin": false, 00:05:59.482 "nvme_io": false 00:05:59.482 }, 00:05:59.482 "memory_domains": [ 00:05:59.482 { 00:05:59.482 "dma_device_id": "system", 00:05:59.482 "dma_device_type": 1 00:05:59.482 }, 00:05:59.482 { 00:05:59.482 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:59.482 "dma_device_type": 2 00:05:59.482 } 00:05:59.482 ], 00:05:59.482 "driver_specific": {} 00:05:59.482 }, 00:05:59.482 { 00:05:59.482 "name": "Passthru0", 00:05:59.482 "aliases": [ 00:05:59.482 "275952d8-79a7-5000-bcc8-9c804fb3a9f9" 00:05:59.482 ], 00:05:59.482 "product_name": "passthru", 00:05:59.482 "block_size": 512, 00:05:59.482 "num_blocks": 16384, 00:05:59.482 "uuid": "275952d8-79a7-5000-bcc8-9c804fb3a9f9", 00:05:59.482 "assigned_rate_limits": { 00:05:59.482 "rw_ios_per_sec": 0, 00:05:59.482 "rw_mbytes_per_sec": 0, 00:05:59.482 "r_mbytes_per_sec": 0, 00:05:59.482 "w_mbytes_per_sec": 0 00:05:59.482 }, 00:05:59.482 "claimed": false, 00:05:59.482 "zoned": false, 00:05:59.482 "supported_io_types": { 00:05:59.482 "read": true, 00:05:59.482 "write": true, 00:05:59.482 "unmap": true, 00:05:59.482 "write_zeroes": true, 00:05:59.482 "flush": true, 00:05:59.482 "reset": true, 00:05:59.482 "compare": false, 00:05:59.482 "compare_and_write": false, 00:05:59.482 "abort": true, 00:05:59.482 "nvme_admin": false, 00:05:59.482 "nvme_io": false 00:05:59.482 }, 00:05:59.482 "memory_domains": [ 00:05:59.482 { 00:05:59.482 "dma_device_id": "system", 00:05:59.482 "dma_device_type": 1 00:05:59.482 }, 00:05:59.482 { 00:05:59.482 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:59.482 "dma_device_type": 2 00:05:59.482 } 00:05:59.482 ], 00:05:59.482 "driver_specific": { 00:05:59.482 "passthru": { 00:05:59.482 "name": "Passthru0", 00:05:59.482 "base_bdev_name": "Malloc2" 00:05:59.482 } 00:05:59.482 } 00:05:59.482 } 00:05:59.482 ]' 00:05:59.482 00:40:06 -- rpc/rpc.sh@21 -- # jq length 00:05:59.482 00:40:06 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:59.482 00:40:06 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:59.482 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.482 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.482 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.482 00:40:06 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:59.482 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.482 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.482 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.482 00:40:06 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:59.482 00:40:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:05:59.482 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.482 00:40:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:05:59.482 00:40:06 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:59.482 00:40:06 -- rpc/rpc.sh@26 -- # jq length 00:05:59.483 00:40:06 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:59.483 00:05:59.483 real 0m0.268s 00:05:59.483 user 0m0.171s 00:05:59.483 sys 0m0.036s 00:05:59.483 00:40:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:05:59.483 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:05:59.483 ************************************ 00:05:59.483 END TEST rpc_daemon_integrity 00:05:59.483 ************************************ 00:05:59.483 00:40:06 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:59.483 00:40:06 -- rpc/rpc.sh@84 -- # killprocess 127974 00:05:59.483 00:40:06 -- common/autotest_common.sh@936 -- # '[' -z 127974 ']' 00:05:59.483 00:40:06 -- common/autotest_common.sh@940 -- # kill -0 127974 00:05:59.483 00:40:06 -- common/autotest_common.sh@941 -- # uname 00:05:59.483 00:40:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.483 00:40:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 127974 00:05:59.483 00:40:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:59.483 00:40:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:59.483 00:40:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 127974' 00:05:59.483 killing process with pid 127974 00:05:59.483 00:40:06 -- common/autotest_common.sh@955 -- # kill 127974 00:05:59.483 00:40:06 -- common/autotest_common.sh@960 -- # wait 127974 00:06:00.053 00:06:00.053 real 0m2.786s 00:06:00.053 user 0m3.571s 00:06:00.053 sys 0m0.842s 00:06:00.053 00:40:06 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:00.053 00:40:06 -- common/autotest_common.sh@10 -- # set +x 00:06:00.053 ************************************ 00:06:00.053 END TEST rpc 00:06:00.053 ************************************ 00:06:00.053 00:40:07 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:06:00.053 00:40:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.053 00:40:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.053 00:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:00.053 ************************************ 00:06:00.053 START TEST skip_rpc 00:06:00.053 ************************************ 00:06:00.053 00:40:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:06:00.053 * Looking for test storage... 00:06:00.053 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:06:00.053 00:40:07 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:00.053 00:40:07 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:00.053 00:40:07 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:06:00.053 00:40:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.053 00:40:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.053 00:40:07 -- common/autotest_common.sh@10 -- # set +x 00:06:00.313 ************************************ 00:06:00.313 START TEST skip_rpc 00:06:00.313 ************************************ 00:06:00.313 00:40:07 -- common/autotest_common.sh@1111 -- # test_skip_rpc 00:06:00.313 00:40:07 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=128840 00:06:00.313 00:40:07 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:00.313 00:40:07 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:06:00.313 00:40:07 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:06:00.313 [2024-04-26 00:40:07.410579] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:00.313 [2024-04-26 00:40:07.410613] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid128840 ] 00:06:00.313 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.313 [2024-04-26 00:40:07.474607] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.573 [2024-04-26 00:40:07.539614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:06:05.846 00:40:12 -- common/autotest_common.sh@638 -- # local es=0 00:06:05.846 00:40:12 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd spdk_get_version 00:06:05.846 00:40:12 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:06:05.846 00:40:12 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:05.846 00:40:12 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:06:05.846 00:40:12 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:05.846 00:40:12 -- common/autotest_common.sh@641 -- # rpc_cmd spdk_get_version 00:06:05.846 00:40:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:05.846 00:40:12 -- common/autotest_common.sh@10 -- # set +x 00:06:05.846 00:40:12 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:05.846 00:40:12 -- common/autotest_common.sh@641 -- # es=1 00:06:05.846 00:40:12 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:05.846 00:40:12 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:05.846 00:40:12 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@23 -- # killprocess 128840 00:06:05.846 00:40:12 -- common/autotest_common.sh@936 -- # '[' -z 128840 ']' 00:06:05.846 00:40:12 -- common/autotest_common.sh@940 -- # kill -0 128840 00:06:05.846 00:40:12 -- common/autotest_common.sh@941 -- # uname 00:06:05.846 00:40:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:05.846 00:40:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 128840 00:06:05.846 00:40:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:05.846 00:40:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:05.846 00:40:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 128840' 00:06:05.846 killing process with pid 128840 00:06:05.846 00:40:12 -- common/autotest_common.sh@955 -- # kill 128840 00:06:05.846 00:40:12 -- common/autotest_common.sh@960 -- # wait 128840 00:06:05.846 00:06:05.846 real 0m5.378s 00:06:05.846 user 0m5.140s 00:06:05.846 sys 0m0.267s 00:06:05.846 00:40:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:05.846 00:40:12 -- common/autotest_common.sh@10 -- # set +x 00:06:05.846 ************************************ 00:06:05.846 END TEST skip_rpc 00:06:05.846 ************************************ 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:06:05.846 00:40:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.846 00:40:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.846 00:40:12 -- common/autotest_common.sh@10 -- # set +x 00:06:05.846 ************************************ 00:06:05.846 START TEST skip_rpc_with_json 00:06:05.846 ************************************ 00:06:05.846 00:40:12 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_json 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=129817 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:05.846 00:40:12 -- rpc/skip_rpc.sh@31 -- # waitforlisten 129817 00:06:05.846 00:40:12 -- common/autotest_common.sh@817 -- # '[' -z 129817 ']' 00:06:05.846 00:40:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:05.846 00:40:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:05.846 00:40:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:05.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:05.846 00:40:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:05.846 00:40:12 -- common/autotest_common.sh@10 -- # set +x 00:06:05.846 [2024-04-26 00:40:12.952322] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:05.846 [2024-04-26 00:40:12.952365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid129817 ] 00:06:05.846 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.846 [2024-04-26 00:40:13.019729] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.104 [2024-04-26 00:40:13.092213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.670 00:40:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:06.670 00:40:13 -- common/autotest_common.sh@850 -- # return 0 00:06:06.670 00:40:13 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:06:06.670 00:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:06.670 00:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:06.670 [2024-04-26 00:40:13.728060] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:06:06.670 request: 00:06:06.670 { 00:06:06.670 "trtype": "tcp", 00:06:06.670 "method": "nvmf_get_transports", 00:06:06.670 "req_id": 1 00:06:06.670 } 00:06:06.670 Got JSON-RPC error response 00:06:06.670 response: 00:06:06.670 { 00:06:06.670 "code": -19, 00:06:06.670 "message": "No such device" 00:06:06.670 } 00:06:06.670 00:40:13 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:06:06.670 00:40:13 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:06:06.670 00:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:06.670 00:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:06.670 [2024-04-26 00:40:13.736140] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:06.670 00:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:06.670 00:40:13 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:06:06.670 00:40:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:06.670 00:40:13 -- common/autotest_common.sh@10 -- # set +x 00:06:06.929 00:40:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:06.929 00:40:13 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:06.929 { 00:06:06.929 "subsystems": [ 00:06:06.929 { 00:06:06.929 "subsystem": "keyring", 00:06:06.929 "config": [] 00:06:06.929 }, 00:06:06.929 { 00:06:06.929 "subsystem": "iobuf", 00:06:06.929 "config": [ 00:06:06.929 { 00:06:06.929 "method": "iobuf_set_options", 00:06:06.929 "params": { 00:06:06.929 "small_pool_count": 8192, 00:06:06.929 "large_pool_count": 1024, 00:06:06.929 "small_bufsize": 8192, 00:06:06.929 "large_bufsize": 135168 00:06:06.929 } 00:06:06.929 } 00:06:06.929 ] 00:06:06.929 }, 00:06:06.929 { 00:06:06.929 "subsystem": "sock", 00:06:06.929 "config": [ 00:06:06.929 { 00:06:06.929 "method": "sock_impl_set_options", 00:06:06.929 "params": { 00:06:06.929 "impl_name": "posix", 00:06:06.929 "recv_buf_size": 2097152, 00:06:06.929 "send_buf_size": 2097152, 00:06:06.929 "enable_recv_pipe": true, 00:06:06.929 "enable_quickack": false, 00:06:06.929 "enable_placement_id": 0, 00:06:06.929 "enable_zerocopy_send_server": true, 00:06:06.929 "enable_zerocopy_send_client": false, 00:06:06.929 "zerocopy_threshold": 0, 00:06:06.929 "tls_version": 0, 00:06:06.929 "enable_ktls": false 00:06:06.929 } 00:06:06.929 }, 00:06:06.929 { 00:06:06.929 "method": "sock_impl_set_options", 00:06:06.929 "params": { 00:06:06.929 "impl_name": "ssl", 00:06:06.929 "recv_buf_size": 4096, 00:06:06.929 "send_buf_size": 4096, 00:06:06.929 "enable_recv_pipe": true, 00:06:06.929 "enable_quickack": false, 00:06:06.929 "enable_placement_id": 0, 00:06:06.929 "enable_zerocopy_send_server": true, 00:06:06.929 "enable_zerocopy_send_client": false, 00:06:06.929 "zerocopy_threshold": 0, 00:06:06.929 "tls_version": 0, 00:06:06.929 "enable_ktls": false 00:06:06.929 } 00:06:06.929 } 00:06:06.929 ] 00:06:06.929 }, 00:06:06.929 { 00:06:06.929 "subsystem": "vmd", 00:06:06.929 "config": [] 00:06:06.929 }, 00:06:06.929 { 00:06:06.929 "subsystem": "accel", 00:06:06.929 "config": [ 00:06:06.929 { 00:06:06.929 "method": "accel_set_options", 00:06:06.929 "params": { 00:06:06.929 "small_cache_size": 128, 00:06:06.929 "large_cache_size": 16, 00:06:06.929 "task_count": 2048, 00:06:06.929 "sequence_count": 2048, 00:06:06.929 "buf_count": 2048 00:06:06.930 } 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "bdev", 00:06:06.930 "config": [ 00:06:06.930 { 00:06:06.930 "method": "bdev_set_options", 00:06:06.930 "params": { 00:06:06.930 "bdev_io_pool_size": 65535, 00:06:06.930 "bdev_io_cache_size": 256, 00:06:06.930 "bdev_auto_examine": true, 00:06:06.930 "iobuf_small_cache_size": 128, 00:06:06.930 "iobuf_large_cache_size": 16 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "bdev_raid_set_options", 00:06:06.930 "params": { 00:06:06.930 "process_window_size_kb": 1024 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "bdev_iscsi_set_options", 00:06:06.930 "params": { 00:06:06.930 "timeout_sec": 30 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "bdev_nvme_set_options", 00:06:06.930 "params": { 00:06:06.930 "action_on_timeout": "none", 00:06:06.930 "timeout_us": 0, 00:06:06.930 "timeout_admin_us": 0, 00:06:06.930 "keep_alive_timeout_ms": 10000, 00:06:06.930 "arbitration_burst": 0, 00:06:06.930 "low_priority_weight": 0, 00:06:06.930 "medium_priority_weight": 0, 00:06:06.930 "high_priority_weight": 0, 00:06:06.930 "nvme_adminq_poll_period_us": 10000, 00:06:06.930 "nvme_ioq_poll_period_us": 0, 00:06:06.930 "io_queue_requests": 0, 00:06:06.930 "delay_cmd_submit": true, 00:06:06.930 "transport_retry_count": 4, 00:06:06.930 "bdev_retry_count": 3, 00:06:06.930 "transport_ack_timeout": 0, 00:06:06.930 "ctrlr_loss_timeout_sec": 0, 00:06:06.930 "reconnect_delay_sec": 0, 00:06:06.930 "fast_io_fail_timeout_sec": 0, 00:06:06.930 "disable_auto_failback": false, 00:06:06.930 "generate_uuids": false, 00:06:06.930 "transport_tos": 0, 00:06:06.930 "nvme_error_stat": false, 00:06:06.930 "rdma_srq_size": 0, 00:06:06.930 "io_path_stat": false, 00:06:06.930 "allow_accel_sequence": false, 00:06:06.930 "rdma_max_cq_size": 0, 00:06:06.930 "rdma_cm_event_timeout_ms": 0, 00:06:06.930 "dhchap_digests": [ 00:06:06.930 "sha256", 00:06:06.930 "sha384", 00:06:06.930 "sha512" 00:06:06.930 ], 00:06:06.930 "dhchap_dhgroups": [ 00:06:06.930 "null", 00:06:06.930 "ffdhe2048", 00:06:06.930 "ffdhe3072", 00:06:06.930 "ffdhe4096", 00:06:06.930 "ffdhe6144", 00:06:06.930 "ffdhe8192" 00:06:06.930 ] 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "bdev_nvme_set_hotplug", 00:06:06.930 "params": { 00:06:06.930 "period_us": 100000, 00:06:06.930 "enable": false 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "bdev_wait_for_examine" 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "scsi", 00:06:06.930 "config": null 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "scheduler", 00:06:06.930 "config": [ 00:06:06.930 { 00:06:06.930 "method": "framework_set_scheduler", 00:06:06.930 "params": { 00:06:06.930 "name": "static" 00:06:06.930 } 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "vhost_scsi", 00:06:06.930 "config": [] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "vhost_blk", 00:06:06.930 "config": [] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "ublk", 00:06:06.930 "config": [] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "nbd", 00:06:06.930 "config": [] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "nvmf", 00:06:06.930 "config": [ 00:06:06.930 { 00:06:06.930 "method": "nvmf_set_config", 00:06:06.930 "params": { 00:06:06.930 "discovery_filter": "match_any", 00:06:06.930 "admin_cmd_passthru": { 00:06:06.930 "identify_ctrlr": false 00:06:06.930 } 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "nvmf_set_max_subsystems", 00:06:06.930 "params": { 00:06:06.930 "max_subsystems": 1024 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "nvmf_set_crdt", 00:06:06.930 "params": { 00:06:06.930 "crdt1": 0, 00:06:06.930 "crdt2": 0, 00:06:06.930 "crdt3": 0 00:06:06.930 } 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "method": "nvmf_create_transport", 00:06:06.930 "params": { 00:06:06.930 "trtype": "TCP", 00:06:06.930 "max_queue_depth": 128, 00:06:06.930 "max_io_qpairs_per_ctrlr": 127, 00:06:06.930 "in_capsule_data_size": 4096, 00:06:06.930 "max_io_size": 131072, 00:06:06.930 "io_unit_size": 131072, 00:06:06.930 "max_aq_depth": 128, 00:06:06.930 "num_shared_buffers": 511, 00:06:06.930 "buf_cache_size": 4294967295, 00:06:06.930 "dif_insert_or_strip": false, 00:06:06.930 "zcopy": false, 00:06:06.930 "c2h_success": true, 00:06:06.930 "sock_priority": 0, 00:06:06.930 "abort_timeout_sec": 1, 00:06:06.930 "ack_timeout": 0, 00:06:06.930 "data_wr_pool_size": 0 00:06:06.930 } 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 }, 00:06:06.930 { 00:06:06.930 "subsystem": "iscsi", 00:06:06.930 "config": [ 00:06:06.930 { 00:06:06.930 "method": "iscsi_set_options", 00:06:06.930 "params": { 00:06:06.930 "node_base": "iqn.2016-06.io.spdk", 00:06:06.930 "max_sessions": 128, 00:06:06.930 "max_connections_per_session": 2, 00:06:06.930 "max_queue_depth": 64, 00:06:06.930 "default_time2wait": 2, 00:06:06.930 "default_time2retain": 20, 00:06:06.930 "first_burst_length": 8192, 00:06:06.930 "immediate_data": true, 00:06:06.930 "allow_duplicated_isid": false, 00:06:06.930 "error_recovery_level": 0, 00:06:06.930 "nop_timeout": 60, 00:06:06.930 "nop_in_interval": 30, 00:06:06.930 "disable_chap": false, 00:06:06.930 "require_chap": false, 00:06:06.930 "mutual_chap": false, 00:06:06.930 "chap_group": 0, 00:06:06.930 "max_large_datain_per_connection": 64, 00:06:06.930 "max_r2t_per_connection": 4, 00:06:06.930 "pdu_pool_size": 36864, 00:06:06.930 "immediate_data_pool_size": 16384, 00:06:06.930 "data_out_pool_size": 2048 00:06:06.930 } 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 } 00:06:06.930 ] 00:06:06.930 } 00:06:06.930 00:40:13 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:06:06.930 00:40:13 -- rpc/skip_rpc.sh@40 -- # killprocess 129817 00:06:06.930 00:40:13 -- common/autotest_common.sh@936 -- # '[' -z 129817 ']' 00:06:06.930 00:40:13 -- common/autotest_common.sh@940 -- # kill -0 129817 00:06:06.930 00:40:13 -- common/autotest_common.sh@941 -- # uname 00:06:06.930 00:40:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.930 00:40:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 129817 00:06:06.930 00:40:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.930 00:40:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.930 00:40:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 129817' 00:06:06.930 killing process with pid 129817 00:06:06.930 00:40:13 -- common/autotest_common.sh@955 -- # kill 129817 00:06:06.930 00:40:13 -- common/autotest_common.sh@960 -- # wait 129817 00:06:07.189 00:40:14 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=130033 00:06:07.189 00:40:14 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:07.189 00:40:14 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:06:12.457 00:40:19 -- rpc/skip_rpc.sh@50 -- # killprocess 130033 00:06:12.457 00:40:19 -- common/autotest_common.sh@936 -- # '[' -z 130033 ']' 00:06:12.457 00:40:19 -- common/autotest_common.sh@940 -- # kill -0 130033 00:06:12.457 00:40:19 -- common/autotest_common.sh@941 -- # uname 00:06:12.457 00:40:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:12.457 00:40:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 130033 00:06:12.457 00:40:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:12.457 00:40:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:12.457 00:40:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 130033' 00:06:12.457 killing process with pid 130033 00:06:12.457 00:40:19 -- common/autotest_common.sh@955 -- # kill 130033 00:06:12.457 00:40:19 -- common/autotest_common.sh@960 -- # wait 130033 00:06:12.457 00:40:19 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:12.457 00:40:19 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:06:12.457 00:06:12.457 real 0m6.733s 00:06:12.457 user 0m6.518s 00:06:12.457 sys 0m0.615s 00:06:12.457 00:40:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:12.457 00:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:12.457 ************************************ 00:06:12.457 END TEST skip_rpc_with_json 00:06:12.457 ************************************ 00:06:12.717 00:40:19 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:06:12.717 00:40:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.717 00:40:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.717 00:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:12.717 ************************************ 00:06:12.717 START TEST skip_rpc_with_delay 00:06:12.717 ************************************ 00:06:12.717 00:40:19 -- common/autotest_common.sh@1111 -- # test_skip_rpc_with_delay 00:06:12.717 00:40:19 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:12.717 00:40:19 -- common/autotest_common.sh@638 -- # local es=0 00:06:12.717 00:40:19 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:12.717 00:40:19 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:12.717 00:40:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:12.717 00:40:19 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:12.717 00:40:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:12.717 00:40:19 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:12.717 00:40:19 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:12.717 00:40:19 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:12.717 00:40:19 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:12.717 00:40:19 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:06:12.717 [2024-04-26 00:40:19.845630] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:06:12.717 [2024-04-26 00:40:19.845691] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:06:12.717 00:40:19 -- common/autotest_common.sh@641 -- # es=1 00:06:12.717 00:40:19 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:12.717 00:40:19 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:06:12.717 00:40:19 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:12.717 00:06:12.717 real 0m0.060s 00:06:12.717 user 0m0.036s 00:06:12.717 sys 0m0.024s 00:06:12.717 00:40:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:12.717 00:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:12.717 ************************************ 00:06:12.717 END TEST skip_rpc_with_delay 00:06:12.717 ************************************ 00:06:12.717 00:40:19 -- rpc/skip_rpc.sh@77 -- # uname 00:06:12.717 00:40:19 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:06:12.717 00:40:19 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:06:12.717 00:40:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.717 00:40:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.717 00:40:19 -- common/autotest_common.sh@10 -- # set +x 00:06:12.983 ************************************ 00:06:12.983 START TEST exit_on_failed_rpc_init 00:06:12.983 ************************************ 00:06:12.983 00:40:20 -- common/autotest_common.sh@1111 -- # test_exit_on_failed_rpc_init 00:06:12.983 00:40:20 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=131173 00:06:12.983 00:40:20 -- rpc/skip_rpc.sh@63 -- # waitforlisten 131173 00:06:12.983 00:40:20 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:12.983 00:40:20 -- common/autotest_common.sh@817 -- # '[' -z 131173 ']' 00:06:12.983 00:40:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:12.983 00:40:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:12.983 00:40:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:12.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:12.983 00:40:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:12.983 00:40:20 -- common/autotest_common.sh@10 -- # set +x 00:06:12.983 [2024-04-26 00:40:20.069856] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:12.983 [2024-04-26 00:40:20.069902] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid131173 ] 00:06:12.983 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.983 [2024-04-26 00:40:20.136657] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.242 [2024-04-26 00:40:20.209755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.809 00:40:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:13.809 00:40:20 -- common/autotest_common.sh@850 -- # return 0 00:06:13.809 00:40:20 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:06:13.809 00:40:20 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:13.809 00:40:20 -- common/autotest_common.sh@638 -- # local es=0 00:06:13.809 00:40:20 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:13.809 00:40:20 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:13.809 00:40:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.809 00:40:20 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:13.809 00:40:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.809 00:40:20 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:13.809 00:40:20 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:06:13.809 00:40:20 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:13.809 00:40:20 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:06:13.809 00:40:20 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:06:13.809 [2024-04-26 00:40:20.889428] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:13.809 [2024-04-26 00:40:20.889469] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid131390 ] 00:06:13.809 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.809 [2024-04-26 00:40:20.954523] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.068 [2024-04-26 00:40:21.020435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:14.068 [2024-04-26 00:40:21.020492] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:06:14.068 [2024-04-26 00:40:21.020500] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:06:14.068 [2024-04-26 00:40:21.020505] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:14.068 00:40:21 -- common/autotest_common.sh@641 -- # es=234 00:06:14.068 00:40:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:06:14.068 00:40:21 -- common/autotest_common.sh@650 -- # es=106 00:06:14.068 00:40:21 -- common/autotest_common.sh@651 -- # case "$es" in 00:06:14.068 00:40:21 -- common/autotest_common.sh@658 -- # es=1 00:06:14.068 00:40:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:06:14.068 00:40:21 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:06:14.068 00:40:21 -- rpc/skip_rpc.sh@70 -- # killprocess 131173 00:06:14.068 00:40:21 -- common/autotest_common.sh@936 -- # '[' -z 131173 ']' 00:06:14.069 00:40:21 -- common/autotest_common.sh@940 -- # kill -0 131173 00:06:14.069 00:40:21 -- common/autotest_common.sh@941 -- # uname 00:06:14.069 00:40:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.069 00:40:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 131173 00:06:14.069 00:40:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.069 00:40:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.069 00:40:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 131173' 00:06:14.069 killing process with pid 131173 00:06:14.069 00:40:21 -- common/autotest_common.sh@955 -- # kill 131173 00:06:14.069 00:40:21 -- common/autotest_common.sh@960 -- # wait 131173 00:06:14.328 00:06:14.328 real 0m1.446s 00:06:14.328 user 0m1.644s 00:06:14.328 sys 0m0.399s 00:06:14.328 00:40:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.328 00:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:14.328 ************************************ 00:06:14.328 END TEST exit_on_failed_rpc_init 00:06:14.328 ************************************ 00:06:14.328 00:40:21 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:06:14.328 00:06:14.328 real 0m14.360s 00:06:14.328 user 0m13.630s 00:06:14.328 sys 0m1.707s 00:06:14.328 00:40:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.328 00:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:14.328 ************************************ 00:06:14.328 END TEST skip_rpc 00:06:14.328 ************************************ 00:06:14.587 00:40:21 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:14.587 00:40:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.587 00:40:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.587 00:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:14.587 ************************************ 00:06:14.587 START TEST rpc_client 00:06:14.587 ************************************ 00:06:14.587 00:40:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:06:14.587 * Looking for test storage... 00:06:14.587 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:06:14.587 00:40:21 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:06:14.846 OK 00:06:14.846 00:40:21 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:06:14.846 00:06:14.846 real 0m0.118s 00:06:14.846 user 0m0.051s 00:06:14.846 sys 0m0.075s 00:06:14.846 00:40:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:14.846 00:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:14.846 ************************************ 00:06:14.846 END TEST rpc_client 00:06:14.846 ************************************ 00:06:14.846 00:40:21 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:06:14.846 00:40:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.846 00:40:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.846 00:40:21 -- common/autotest_common.sh@10 -- # set +x 00:06:14.846 ************************************ 00:06:14.846 START TEST json_config 00:06:14.846 ************************************ 00:06:14.846 00:40:21 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:06:14.846 00:40:22 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:14.846 00:40:22 -- nvmf/common.sh@7 -- # uname -s 00:06:14.846 00:40:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:14.846 00:40:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:14.846 00:40:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:14.846 00:40:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:14.846 00:40:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:14.846 00:40:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:14.846 00:40:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:14.846 00:40:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:14.846 00:40:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:14.846 00:40:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:15.105 00:40:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:06:15.105 00:40:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:06:15.105 00:40:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:15.105 00:40:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:15.105 00:40:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:15.105 00:40:22 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:15.105 00:40:22 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:15.105 00:40:22 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:15.105 00:40:22 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:15.105 00:40:22 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:15.105 00:40:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:15.105 00:40:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:15.105 00:40:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:15.105 00:40:22 -- paths/export.sh@5 -- # export PATH 00:06:15.105 00:40:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:15.105 00:40:22 -- nvmf/common.sh@47 -- # : 0 00:06:15.105 00:40:22 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:15.105 00:40:22 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:15.105 00:40:22 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:15.105 00:40:22 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:15.105 00:40:22 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:15.105 00:40:22 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:15.105 00:40:22 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:15.105 00:40:22 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:15.105 00:40:22 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:06:15.105 00:40:22 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:06:15.105 00:40:22 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:06:15.105 00:40:22 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:06:15.105 00:40:22 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:06:15.105 00:40:22 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:06:15.106 00:40:22 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:06:15.106 00:40:22 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:06:15.106 00:40:22 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:06:15.106 00:40:22 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:06:15.106 00:40:22 -- json_config/json_config.sh@33 -- # declare -A app_params 00:06:15.106 00:40:22 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:06:15.106 00:40:22 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:06:15.106 00:40:22 -- json_config/json_config.sh@40 -- # last_event_id=0 00:06:15.106 00:40:22 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:15.106 00:40:22 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:06:15.106 INFO: JSON configuration test init 00:06:15.106 00:40:22 -- json_config/json_config.sh@357 -- # json_config_test_init 00:06:15.106 00:40:22 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:06:15.106 00:40:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:15.106 00:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:15.106 00:40:22 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:06:15.106 00:40:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:15.106 00:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:15.106 00:40:22 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:06:15.106 00:40:22 -- json_config/common.sh@9 -- # local app=target 00:06:15.106 00:40:22 -- json_config/common.sh@10 -- # shift 00:06:15.106 00:40:22 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:15.106 00:40:22 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:15.106 00:40:22 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:15.106 00:40:22 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:15.106 00:40:22 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:15.106 00:40:22 -- json_config/common.sh@22 -- # app_pid["$app"]=131772 00:06:15.106 00:40:22 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:15.106 Waiting for target to run... 00:06:15.106 00:40:22 -- json_config/common.sh@25 -- # waitforlisten 131772 /var/tmp/spdk_tgt.sock 00:06:15.106 00:40:22 -- common/autotest_common.sh@817 -- # '[' -z 131772 ']' 00:06:15.106 00:40:22 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:06:15.106 00:40:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:15.106 00:40:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:15.106 00:40:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:15.106 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:15.106 00:40:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:15.106 00:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:15.106 [2024-04-26 00:40:22.114963] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:15.106 [2024-04-26 00:40:22.115006] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid131772 ] 00:06:15.106 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.363 [2024-04-26 00:40:22.536248] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.621 [2024-04-26 00:40:22.622923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.879 00:40:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:15.879 00:40:22 -- common/autotest_common.sh@850 -- # return 0 00:06:15.879 00:40:22 -- json_config/common.sh@26 -- # echo '' 00:06:15.879 00:06:15.879 00:40:22 -- json_config/json_config.sh@269 -- # create_accel_config 00:06:15.879 00:40:22 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:06:15.879 00:40:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:15.879 00:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:15.879 00:40:22 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:06:15.879 00:40:22 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:06:15.879 00:40:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:15.879 00:40:22 -- common/autotest_common.sh@10 -- # set +x 00:06:15.879 00:40:22 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:06:15.879 00:40:22 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:06:15.879 00:40:22 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:06:19.166 00:40:25 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:06:19.166 00:40:25 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:06:19.166 00:40:25 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:19.166 00:40:25 -- common/autotest_common.sh@10 -- # set +x 00:06:19.166 00:40:25 -- json_config/json_config.sh@45 -- # local ret=0 00:06:19.166 00:40:25 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:06:19.166 00:40:25 -- json_config/json_config.sh@46 -- # local enabled_types 00:06:19.166 00:40:25 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:06:19.166 00:40:25 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:06:19.166 00:40:25 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:06:19.166 00:40:26 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:06:19.166 00:40:26 -- json_config/json_config.sh@48 -- # local get_types 00:06:19.166 00:40:26 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:06:19.166 00:40:26 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:19.166 00:40:26 -- common/autotest_common.sh@10 -- # set +x 00:06:19.166 00:40:26 -- json_config/json_config.sh@55 -- # return 0 00:06:19.166 00:40:26 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:06:19.166 00:40:26 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:06:19.166 00:40:26 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:19.166 00:40:26 -- common/autotest_common.sh@10 -- # set +x 00:06:19.166 00:40:26 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:06:19.166 00:40:26 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:06:19.166 00:40:26 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:06:19.166 00:40:26 -- json_config/json_config.sh@234 -- # nvmftestinit 00:06:19.166 00:40:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:06:19.166 00:40:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:19.166 00:40:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:06:19.166 00:40:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:06:19.166 00:40:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:06:19.166 00:40:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:19.166 00:40:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:06:19.166 00:40:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:19.166 00:40:26 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:06:19.166 00:40:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:06:19.166 00:40:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:06:19.166 00:40:26 -- common/autotest_common.sh@10 -- # set +x 00:06:25.736 00:40:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:25.736 00:40:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:06:25.736 00:40:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:06:25.736 00:40:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:06:25.736 00:40:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:06:25.736 00:40:31 -- nvmf/common.sh@295 -- # net_devs=() 00:06:25.736 00:40:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@296 -- # e810=() 00:06:25.736 00:40:31 -- nvmf/common.sh@296 -- # local -ga e810 00:06:25.736 00:40:31 -- nvmf/common.sh@297 -- # x722=() 00:06:25.736 00:40:31 -- nvmf/common.sh@297 -- # local -ga x722 00:06:25.736 00:40:31 -- nvmf/common.sh@298 -- # mlx=() 00:06:25.736 00:40:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:06:25.736 00:40:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:25.736 00:40:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:06:25.736 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:06:25.736 00:40:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:25.736 00:40:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:06:25.736 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:06:25.736 00:40:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:06:25.736 00:40:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:25.736 00:40:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:25.736 00:40:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:06:25.736 Found net devices under 0000:18:00.0: mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:25.736 00:40:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:25.736 00:40:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:06:25.736 Found net devices under 0000:18:00.1: mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:06:25.736 00:40:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:06:25.736 00:40:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:06:25.736 00:40:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:06:25.736 00:40:31 -- nvmf/common.sh@58 -- # uname 00:06:25.736 00:40:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:06:25.736 00:40:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:06:25.736 00:40:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:06:25.736 00:40:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:06:25.736 00:40:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:06:25.736 00:40:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:06:25.736 00:40:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:06:25.736 00:40:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:06:25.736 00:40:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:06:25.736 00:40:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:06:25.736 00:40:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:06:25.736 00:40:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:25.736 00:40:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:25.736 00:40:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@105 -- # continue 2 00:06:25.736 00:40:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@105 -- # continue 2 00:06:25.736 00:40:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:25.736 00:40:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:25.736 00:40:31 -- nvmf/common.sh@74 -- # ip= 00:06:25.736 00:40:31 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@77 -- # ip link set mlx_0_0 up 00:06:25.736 00:40:31 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:06:25.736 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:25.736 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:06:25.736 altname enp24s0f0np0 00:06:25.736 altname ens785f0np0 00:06:25.736 inet 192.168.100.8/24 scope global mlx_0_0 00:06:25.736 valid_lft forever preferred_lft forever 00:06:25.736 00:40:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:06:25.736 00:40:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:25.736 00:40:31 -- nvmf/common.sh@74 -- # ip= 00:06:25.736 00:40:31 -- nvmf/common.sh@75 -- # [[ -z '' ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@76 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@77 -- # ip link set mlx_0_1 up 00:06:25.736 00:40:31 -- nvmf/common.sh@78 -- # (( count = count + 1 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:06:25.736 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:06:25.736 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:06:25.736 altname enp24s0f1np1 00:06:25.736 altname ens785f1np1 00:06:25.736 inet 192.168.100.9/24 scope global mlx_0_1 00:06:25.736 valid_lft forever preferred_lft forever 00:06:25.736 00:40:31 -- nvmf/common.sh@411 -- # return 0 00:06:25.736 00:40:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:06:25.736 00:40:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:06:25.736 00:40:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:06:25.736 00:40:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:06:25.736 00:40:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:06:25.736 00:40:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:06:25.736 00:40:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:06:25.736 00:40:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:06:25.736 00:40:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@105 -- # continue 2 00:06:25.736 00:40:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:06:25.736 00:40:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:06:25.736 00:40:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@105 -- # continue 2 00:06:25.736 00:40:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:25.736 00:40:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:25.736 00:40:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:06:25.736 00:40:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:06:25.736 00:40:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:06:25.736 00:40:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:06:25.736 192.168.100.9' 00:06:25.736 00:40:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:06:25.736 192.168.100.9' 00:06:25.736 00:40:31 -- nvmf/common.sh@446 -- # head -n 1 00:06:25.736 00:40:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:06:25.736 00:40:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:06:25.736 192.168.100.9' 00:06:25.736 00:40:31 -- nvmf/common.sh@447 -- # tail -n +2 00:06:25.736 00:40:31 -- nvmf/common.sh@447 -- # head -n 1 00:06:25.736 00:40:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:06:25.736 00:40:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:06:25.736 00:40:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:06:25.736 00:40:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:06:25.736 00:40:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:06:25.736 00:40:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:06:25.736 00:40:31 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:06:25.736 00:40:31 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:25.736 00:40:31 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:06:25.736 MallocForNvmf0 00:06:25.736 00:40:32 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:25.736 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:06:25.736 MallocForNvmf1 00:06:25.736 00:40:32 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:06:25.736 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:06:25.736 [2024-04-26 00:40:32.391190] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:06:25.736 [2024-04-26 00:40:32.433902] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bf8760/0x1d45880) succeed. 00:06:25.736 [2024-04-26 00:40:32.444178] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bfa950/0x1ca57c0) succeed. 00:06:25.736 00:40:32 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:25.736 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:25.736 00:40:32 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:25.736 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:06:25.736 00:40:32 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:25.736 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:06:25.996 00:40:32 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:25.996 00:40:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:06:25.996 [2024-04-26 00:40:33.067986] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:25.996 00:40:33 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:06:25.996 00:40:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:25.996 00:40:33 -- common/autotest_common.sh@10 -- # set +x 00:06:25.996 00:40:33 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:06:25.996 00:40:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:25.996 00:40:33 -- common/autotest_common.sh@10 -- # set +x 00:06:25.996 00:40:33 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:06:25.996 00:40:33 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:25.996 00:40:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:06:26.255 MallocBdevForConfigChangeCheck 00:06:26.255 00:40:33 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:06:26.255 00:40:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:26.255 00:40:33 -- common/autotest_common.sh@10 -- # set +x 00:06:26.255 00:40:33 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:06:26.255 00:40:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:26.514 00:40:33 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:06:26.514 INFO: shutting down applications... 00:06:26.514 00:40:33 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:06:26.514 00:40:33 -- json_config/json_config.sh@368 -- # json_config_clear target 00:06:26.514 00:40:33 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:06:26.514 00:40:33 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:06:30.706 Calling clear_iscsi_subsystem 00:06:30.706 Calling clear_nvmf_subsystem 00:06:30.706 Calling clear_nbd_subsystem 00:06:30.706 Calling clear_ublk_subsystem 00:06:30.706 Calling clear_vhost_blk_subsystem 00:06:30.706 Calling clear_vhost_scsi_subsystem 00:06:30.706 Calling clear_bdev_subsystem 00:06:30.706 00:40:37 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:06:30.706 00:40:37 -- json_config/json_config.sh@343 -- # count=100 00:06:30.706 00:40:37 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:06:30.706 00:40:37 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:30.706 00:40:37 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:06:30.706 00:40:37 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:06:30.706 00:40:37 -- json_config/json_config.sh@345 -- # break 00:06:30.706 00:40:37 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:06:30.706 00:40:37 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:06:30.706 00:40:37 -- json_config/common.sh@31 -- # local app=target 00:06:30.706 00:40:37 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:30.706 00:40:37 -- json_config/common.sh@35 -- # [[ -n 131772 ]] 00:06:30.706 00:40:37 -- json_config/common.sh@38 -- # kill -SIGINT 131772 00:06:30.706 00:40:37 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:30.706 00:40:37 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:30.706 00:40:37 -- json_config/common.sh@41 -- # kill -0 131772 00:06:30.707 00:40:37 -- json_config/common.sh@45 -- # sleep 0.5 00:06:30.966 [2024-04-26 00:40:37.918748] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:31.225 00:40:38 -- json_config/common.sh@40 -- # (( i++ )) 00:06:31.225 00:40:38 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:31.225 00:40:38 -- json_config/common.sh@41 -- # kill -0 131772 00:06:31.225 00:40:38 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:31.225 00:40:38 -- json_config/common.sh@43 -- # break 00:06:31.225 00:40:38 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:31.225 00:40:38 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:31.225 SPDK target shutdown done 00:06:31.225 00:40:38 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:06:31.225 INFO: relaunching applications... 00:06:31.225 00:40:38 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:31.225 00:40:38 -- json_config/common.sh@9 -- # local app=target 00:06:31.225 00:40:38 -- json_config/common.sh@10 -- # shift 00:06:31.225 00:40:38 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:31.225 00:40:38 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:31.225 00:40:38 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:31.225 00:40:38 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:31.225 00:40:38 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:31.225 00:40:38 -- json_config/common.sh@22 -- # app_pid["$app"]=136936 00:06:31.225 00:40:38 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:31.225 Waiting for target to run... 00:06:31.225 00:40:38 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:31.225 00:40:38 -- json_config/common.sh@25 -- # waitforlisten 136936 /var/tmp/spdk_tgt.sock 00:06:31.225 00:40:38 -- common/autotest_common.sh@817 -- # '[' -z 136936 ']' 00:06:31.225 00:40:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:31.225 00:40:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:31.225 00:40:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:31.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:31.225 00:40:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:31.225 00:40:38 -- common/autotest_common.sh@10 -- # set +x 00:06:31.225 [2024-04-26 00:40:38.374639] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:31.226 [2024-04-26 00:40:38.374682] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid136936 ] 00:06:31.226 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.484 [2024-04-26 00:40:38.658470] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.744 [2024-04-26 00:40:38.719538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.034 [2024-04-26 00:40:41.736892] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x23689b0/0x22eecc0) succeed. 00:06:35.034 [2024-04-26 00:40:41.746193] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x23679a0/0x21ceb80) succeed. 00:06:35.034 [2024-04-26 00:40:41.794329] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:06:35.293 00:40:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:35.293 00:40:42 -- common/autotest_common.sh@850 -- # return 0 00:06:35.293 00:40:42 -- json_config/common.sh@26 -- # echo '' 00:06:35.293 00:06:35.293 00:40:42 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:06:35.293 00:40:42 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:06:35.293 INFO: Checking if target configuration is the same... 00:06:35.293 00:40:42 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:06:35.293 00:40:42 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:35.293 00:40:42 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:35.293 + '[' 2 -ne 2 ']' 00:06:35.293 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:35.293 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:06:35.293 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:35.293 +++ basename /dev/fd/62 00:06:35.293 ++ mktemp /tmp/62.XXX 00:06:35.293 + tmp_file_1=/tmp/62.JDU 00:06:35.293 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:35.293 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:35.293 + tmp_file_2=/tmp/spdk_tgt_config.json.85g 00:06:35.293 + ret=0 00:06:35.293 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:35.862 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:35.862 + diff -u /tmp/62.JDU /tmp/spdk_tgt_config.json.85g 00:06:35.862 + echo 'INFO: JSON config files are the same' 00:06:35.862 INFO: JSON config files are the same 00:06:35.862 + rm /tmp/62.JDU /tmp/spdk_tgt_config.json.85g 00:06:35.862 + exit 0 00:06:35.862 00:40:42 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:06:35.862 00:40:42 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:06:35.862 INFO: changing configuration and checking if this can be detected... 00:06:35.862 00:40:42 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:35.862 00:40:42 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:06:35.862 00:40:42 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:35.862 00:40:42 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:06:35.863 00:40:42 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:06:35.863 + '[' 2 -ne 2 ']' 00:06:35.863 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:06:35.863 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:06:35.863 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:06:35.863 +++ basename /dev/fd/62 00:06:35.863 ++ mktemp /tmp/62.XXX 00:06:35.863 + tmp_file_1=/tmp/62.izA 00:06:35.863 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:35.863 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:06:35.863 + tmp_file_2=/tmp/spdk_tgt_config.json.HJs 00:06:35.863 + ret=0 00:06:35.863 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:36.130 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:06:36.130 + diff -u /tmp/62.izA /tmp/spdk_tgt_config.json.HJs 00:06:36.130 + ret=1 00:06:36.130 + echo '=== Start of file: /tmp/62.izA ===' 00:06:36.130 + cat /tmp/62.izA 00:06:36.130 + echo '=== End of file: /tmp/62.izA ===' 00:06:36.130 + echo '' 00:06:36.130 + echo '=== Start of file: /tmp/spdk_tgt_config.json.HJs ===' 00:06:36.130 + cat /tmp/spdk_tgt_config.json.HJs 00:06:36.130 + echo '=== End of file: /tmp/spdk_tgt_config.json.HJs ===' 00:06:36.130 + echo '' 00:06:36.130 + rm /tmp/62.izA /tmp/spdk_tgt_config.json.HJs 00:06:36.130 + exit 1 00:06:36.130 00:40:43 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:06:36.130 INFO: configuration change detected. 00:06:36.130 00:40:43 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:06:36.130 00:40:43 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:06:36.130 00:40:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:36.130 00:40:43 -- common/autotest_common.sh@10 -- # set +x 00:06:36.130 00:40:43 -- json_config/json_config.sh@307 -- # local ret=0 00:06:36.130 00:40:43 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:06:36.130 00:40:43 -- json_config/json_config.sh@317 -- # [[ -n 136936 ]] 00:06:36.130 00:40:43 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:06:36.130 00:40:43 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:06:36.130 00:40:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:36.130 00:40:43 -- common/autotest_common.sh@10 -- # set +x 00:06:36.130 00:40:43 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:06:36.130 00:40:43 -- json_config/json_config.sh@193 -- # uname -s 00:06:36.130 00:40:43 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:06:36.130 00:40:43 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:06:36.130 00:40:43 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:06:36.130 00:40:43 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:06:36.130 00:40:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:36.130 00:40:43 -- common/autotest_common.sh@10 -- # set +x 00:06:36.389 00:40:43 -- json_config/json_config.sh@323 -- # killprocess 136936 00:06:36.389 00:40:43 -- common/autotest_common.sh@936 -- # '[' -z 136936 ']' 00:06:36.389 00:40:43 -- common/autotest_common.sh@940 -- # kill -0 136936 00:06:36.389 00:40:43 -- common/autotest_common.sh@941 -- # uname 00:06:36.389 00:40:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.389 00:40:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 136936 00:06:36.389 00:40:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.389 00:40:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.389 00:40:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 136936' 00:06:36.389 killing process with pid 136936 00:06:36.389 00:40:43 -- common/autotest_common.sh@955 -- # kill 136936 00:06:36.389 00:40:43 -- common/autotest_common.sh@960 -- # wait 136936 00:06:36.389 [2024-04-26 00:40:43.497925] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:06:40.579 00:40:47 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:06:40.580 00:40:47 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:06:40.580 00:40:47 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:40.580 00:40:47 -- common/autotest_common.sh@10 -- # set +x 00:06:40.580 00:40:47 -- json_config/json_config.sh@328 -- # return 0 00:06:40.580 00:40:47 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:06:40.580 INFO: Success 00:06:40.580 00:40:47 -- json_config/json_config.sh@1 -- # nvmftestfini 00:06:40.580 00:40:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:06:40.580 00:40:47 -- nvmf/common.sh@117 -- # sync 00:06:40.580 00:40:47 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:06:40.580 00:06:40.580 real 0m25.334s 00:06:40.580 user 0m27.362s 00:06:40.580 sys 0m6.213s 00:06:40.580 00:40:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:40.580 00:40:47 -- common/autotest_common.sh@10 -- # set +x 00:06:40.580 ************************************ 00:06:40.580 END TEST json_config 00:06:40.580 ************************************ 00:06:40.580 00:40:47 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:40.580 00:40:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:40.580 00:40:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.580 00:40:47 -- common/autotest_common.sh@10 -- # set +x 00:06:40.580 ************************************ 00:06:40.580 START TEST json_config_extra_key 00:06:40.580 ************************************ 00:06:40.580 00:40:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.580 00:40:47 -- nvmf/common.sh@7 -- # uname -s 00:06:40.580 00:40:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.580 00:40:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.580 00:40:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.580 00:40:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.580 00:40:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.580 00:40:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.580 00:40:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.580 00:40:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.580 00:40:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.580 00:40:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.580 00:40:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:06:40.580 00:40:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:06:40.580 00:40:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.580 00:40:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.580 00:40:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:06:40.580 00:40:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:40.580 00:40:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:06:40.580 00:40:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.580 00:40:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.580 00:40:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.580 00:40:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.580 00:40:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.580 00:40:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.580 00:40:47 -- paths/export.sh@5 -- # export PATH 00:06:40.580 00:40:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.580 00:40:47 -- nvmf/common.sh@47 -- # : 0 00:06:40.580 00:40:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:06:40.580 00:40:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:06:40.580 00:40:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.580 00:40:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.580 00:40:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:06:40.580 00:40:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:06:40.580 INFO: launching applications... 00:06:40.580 00:40:47 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:06:40.580 00:40:47 -- json_config/common.sh@9 -- # local app=target 00:06:40.580 00:40:47 -- json_config/common.sh@10 -- # shift 00:06:40.580 00:40:47 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:06:40.580 00:40:47 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:06:40.580 00:40:47 -- json_config/common.sh@15 -- # local app_extra_params= 00:06:40.580 00:40:47 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:40.580 00:40:47 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:06:40.580 00:40:47 -- json_config/common.sh@22 -- # app_pid["$app"]=138889 00:06:40.580 00:40:47 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:06:40.580 Waiting for target to run... 00:06:40.580 00:40:47 -- json_config/common.sh@25 -- # waitforlisten 138889 /var/tmp/spdk_tgt.sock 00:06:40.580 00:40:47 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:06:40.580 00:40:47 -- common/autotest_common.sh@817 -- # '[' -z 138889 ']' 00:06:40.580 00:40:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:06:40.580 00:40:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:40.580 00:40:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:06:40.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:06:40.580 00:40:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:40.580 00:40:47 -- common/autotest_common.sh@10 -- # set +x 00:06:40.580 [2024-04-26 00:40:47.613068] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:40.580 [2024-04-26 00:40:47.613114] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid138889 ] 00:06:40.580 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.149 [2024-04-26 00:40:48.036036] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.149 [2024-04-26 00:40:48.119329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.408 00:40:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:41.408 00:40:48 -- common/autotest_common.sh@850 -- # return 0 00:06:41.408 00:40:48 -- json_config/common.sh@26 -- # echo '' 00:06:41.408 00:06:41.408 00:40:48 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:06:41.408 INFO: shutting down applications... 00:06:41.408 00:40:48 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:06:41.408 00:40:48 -- json_config/common.sh@31 -- # local app=target 00:06:41.408 00:40:48 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:06:41.408 00:40:48 -- json_config/common.sh@35 -- # [[ -n 138889 ]] 00:06:41.408 00:40:48 -- json_config/common.sh@38 -- # kill -SIGINT 138889 00:06:41.408 00:40:48 -- json_config/common.sh@40 -- # (( i = 0 )) 00:06:41.408 00:40:48 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:41.408 00:40:48 -- json_config/common.sh@41 -- # kill -0 138889 00:06:41.408 00:40:48 -- json_config/common.sh@45 -- # sleep 0.5 00:06:41.977 00:40:48 -- json_config/common.sh@40 -- # (( i++ )) 00:06:41.977 00:40:48 -- json_config/common.sh@40 -- # (( i < 30 )) 00:06:41.977 00:40:48 -- json_config/common.sh@41 -- # kill -0 138889 00:06:41.977 00:40:48 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:06:41.977 00:40:48 -- json_config/common.sh@43 -- # break 00:06:41.977 00:40:48 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:06:41.977 00:40:48 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:06:41.977 SPDK target shutdown done 00:06:41.977 00:40:48 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:06:41.977 Success 00:06:41.977 00:06:41.977 real 0m1.423s 00:06:41.977 user 0m1.055s 00:06:41.977 sys 0m0.516s 00:06:41.977 00:40:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:41.977 00:40:48 -- common/autotest_common.sh@10 -- # set +x 00:06:41.977 ************************************ 00:06:41.977 END TEST json_config_extra_key 00:06:41.977 ************************************ 00:06:41.977 00:40:48 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:41.977 00:40:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.977 00:40:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.977 00:40:48 -- common/autotest_common.sh@10 -- # set +x 00:06:41.977 ************************************ 00:06:41.977 START TEST alias_rpc 00:06:41.977 ************************************ 00:06:41.977 00:40:49 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:41.977 * Looking for test storage... 00:06:41.977 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:06:41.977 00:40:49 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:41.977 00:40:49 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=139212 00:06:41.977 00:40:49 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 139212 00:06:41.977 00:40:49 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:41.977 00:40:49 -- common/autotest_common.sh@817 -- # '[' -z 139212 ']' 00:06:41.977 00:40:49 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.977 00:40:49 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:41.977 00:40:49 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.977 00:40:49 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:41.977 00:40:49 -- common/autotest_common.sh@10 -- # set +x 00:06:42.237 [2024-04-26 00:40:49.192283] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:42.237 [2024-04-26 00:40:49.192335] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139212 ] 00:06:42.237 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.237 [2024-04-26 00:40:49.258177] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.237 [2024-04-26 00:40:49.329484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.805 00:40:49 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:42.805 00:40:49 -- common/autotest_common.sh@850 -- # return 0 00:06:42.805 00:40:49 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:43.065 00:40:50 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 139212 00:06:43.065 00:40:50 -- common/autotest_common.sh@936 -- # '[' -z 139212 ']' 00:06:43.065 00:40:50 -- common/autotest_common.sh@940 -- # kill -0 139212 00:06:43.065 00:40:50 -- common/autotest_common.sh@941 -- # uname 00:06:43.065 00:40:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:43.065 00:40:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 139212 00:06:43.065 00:40:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:43.065 00:40:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:43.065 00:40:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 139212' 00:06:43.065 killing process with pid 139212 00:06:43.065 00:40:50 -- common/autotest_common.sh@955 -- # kill 139212 00:06:43.065 00:40:50 -- common/autotest_common.sh@960 -- # wait 139212 00:06:43.324 00:06:43.324 real 0m1.452s 00:06:43.324 user 0m1.534s 00:06:43.324 sys 0m0.403s 00:06:43.324 00:40:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:43.324 00:40:50 -- common/autotest_common.sh@10 -- # set +x 00:06:43.324 ************************************ 00:06:43.324 END TEST alias_rpc 00:06:43.324 ************************************ 00:06:43.584 00:40:50 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:06:43.584 00:40:50 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:43.584 00:40:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.584 00:40:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.584 00:40:50 -- common/autotest_common.sh@10 -- # set +x 00:06:43.584 ************************************ 00:06:43.584 START TEST spdkcli_tcp 00:06:43.584 ************************************ 00:06:43.584 00:40:50 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:43.584 * Looking for test storage... 00:06:43.584 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:06:43.584 00:40:50 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:43.584 00:40:50 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:43.584 00:40:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:06:43.584 00:40:50 -- common/autotest_common.sh@10 -- # set +x 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=139537 00:06:43.584 00:40:50 -- spdkcli/tcp.sh@27 -- # waitforlisten 139537 00:06:43.585 00:40:50 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:43.585 00:40:50 -- common/autotest_common.sh@817 -- # '[' -z 139537 ']' 00:06:43.585 00:40:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.585 00:40:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:43.585 00:40:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.585 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.843 00:40:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:43.843 00:40:50 -- common/autotest_common.sh@10 -- # set +x 00:06:43.843 [2024-04-26 00:40:50.822565] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:43.843 [2024-04-26 00:40:50.822603] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139537 ] 00:06:43.843 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.843 [2024-04-26 00:40:50.888895] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:43.843 [2024-04-26 00:40:50.958721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:43.843 [2024-04-26 00:40:50.958722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.410 00:40:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:44.410 00:40:51 -- common/autotest_common.sh@850 -- # return 0 00:06:44.410 00:40:51 -- spdkcli/tcp.sh@31 -- # socat_pid=139701 00:06:44.410 00:40:51 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:44.410 00:40:51 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:44.669 [ 00:06:44.669 "bdev_malloc_delete", 00:06:44.669 "bdev_malloc_create", 00:06:44.669 "bdev_null_resize", 00:06:44.669 "bdev_null_delete", 00:06:44.669 "bdev_null_create", 00:06:44.669 "bdev_nvme_cuse_unregister", 00:06:44.669 "bdev_nvme_cuse_register", 00:06:44.669 "bdev_opal_new_user", 00:06:44.669 "bdev_opal_set_lock_state", 00:06:44.669 "bdev_opal_delete", 00:06:44.669 "bdev_opal_get_info", 00:06:44.669 "bdev_opal_create", 00:06:44.669 "bdev_nvme_opal_revert", 00:06:44.669 "bdev_nvme_opal_init", 00:06:44.669 "bdev_nvme_send_cmd", 00:06:44.669 "bdev_nvme_get_path_iostat", 00:06:44.669 "bdev_nvme_get_mdns_discovery_info", 00:06:44.669 "bdev_nvme_stop_mdns_discovery", 00:06:44.669 "bdev_nvme_start_mdns_discovery", 00:06:44.669 "bdev_nvme_set_multipath_policy", 00:06:44.669 "bdev_nvme_set_preferred_path", 00:06:44.669 "bdev_nvme_get_io_paths", 00:06:44.669 "bdev_nvme_remove_error_injection", 00:06:44.669 "bdev_nvme_add_error_injection", 00:06:44.669 "bdev_nvme_get_discovery_info", 00:06:44.669 "bdev_nvme_stop_discovery", 00:06:44.669 "bdev_nvme_start_discovery", 00:06:44.669 "bdev_nvme_get_controller_health_info", 00:06:44.669 "bdev_nvme_disable_controller", 00:06:44.669 "bdev_nvme_enable_controller", 00:06:44.669 "bdev_nvme_reset_controller", 00:06:44.669 "bdev_nvme_get_transport_statistics", 00:06:44.669 "bdev_nvme_apply_firmware", 00:06:44.669 "bdev_nvme_detach_controller", 00:06:44.669 "bdev_nvme_get_controllers", 00:06:44.669 "bdev_nvme_attach_controller", 00:06:44.669 "bdev_nvme_set_hotplug", 00:06:44.669 "bdev_nvme_set_options", 00:06:44.669 "bdev_passthru_delete", 00:06:44.669 "bdev_passthru_create", 00:06:44.669 "bdev_lvol_grow_lvstore", 00:06:44.669 "bdev_lvol_get_lvols", 00:06:44.669 "bdev_lvol_get_lvstores", 00:06:44.669 "bdev_lvol_delete", 00:06:44.669 "bdev_lvol_set_read_only", 00:06:44.669 "bdev_lvol_resize", 00:06:44.669 "bdev_lvol_decouple_parent", 00:06:44.669 "bdev_lvol_inflate", 00:06:44.669 "bdev_lvol_rename", 00:06:44.669 "bdev_lvol_clone_bdev", 00:06:44.669 "bdev_lvol_clone", 00:06:44.669 "bdev_lvol_snapshot", 00:06:44.669 "bdev_lvol_create", 00:06:44.669 "bdev_lvol_delete_lvstore", 00:06:44.669 "bdev_lvol_rename_lvstore", 00:06:44.669 "bdev_lvol_create_lvstore", 00:06:44.669 "bdev_raid_set_options", 00:06:44.669 "bdev_raid_remove_base_bdev", 00:06:44.669 "bdev_raid_add_base_bdev", 00:06:44.669 "bdev_raid_delete", 00:06:44.669 "bdev_raid_create", 00:06:44.669 "bdev_raid_get_bdevs", 00:06:44.669 "bdev_error_inject_error", 00:06:44.669 "bdev_error_delete", 00:06:44.669 "bdev_error_create", 00:06:44.669 "bdev_split_delete", 00:06:44.669 "bdev_split_create", 00:06:44.669 "bdev_delay_delete", 00:06:44.669 "bdev_delay_create", 00:06:44.669 "bdev_delay_update_latency", 00:06:44.669 "bdev_zone_block_delete", 00:06:44.669 "bdev_zone_block_create", 00:06:44.669 "blobfs_create", 00:06:44.669 "blobfs_detect", 00:06:44.669 "blobfs_set_cache_size", 00:06:44.669 "bdev_aio_delete", 00:06:44.669 "bdev_aio_rescan", 00:06:44.669 "bdev_aio_create", 00:06:44.669 "bdev_ftl_set_property", 00:06:44.669 "bdev_ftl_get_properties", 00:06:44.669 "bdev_ftl_get_stats", 00:06:44.669 "bdev_ftl_unmap", 00:06:44.669 "bdev_ftl_unload", 00:06:44.669 "bdev_ftl_delete", 00:06:44.669 "bdev_ftl_load", 00:06:44.669 "bdev_ftl_create", 00:06:44.669 "bdev_virtio_attach_controller", 00:06:44.669 "bdev_virtio_scsi_get_devices", 00:06:44.669 "bdev_virtio_detach_controller", 00:06:44.669 "bdev_virtio_blk_set_hotplug", 00:06:44.669 "bdev_iscsi_delete", 00:06:44.669 "bdev_iscsi_create", 00:06:44.669 "bdev_iscsi_set_options", 00:06:44.669 "accel_error_inject_error", 00:06:44.669 "ioat_scan_accel_module", 00:06:44.669 "dsa_scan_accel_module", 00:06:44.669 "iaa_scan_accel_module", 00:06:44.669 "keyring_file_remove_key", 00:06:44.669 "keyring_file_add_key", 00:06:44.669 "iscsi_get_histogram", 00:06:44.669 "iscsi_enable_histogram", 00:06:44.669 "iscsi_set_options", 00:06:44.669 "iscsi_get_auth_groups", 00:06:44.669 "iscsi_auth_group_remove_secret", 00:06:44.669 "iscsi_auth_group_add_secret", 00:06:44.669 "iscsi_delete_auth_group", 00:06:44.669 "iscsi_create_auth_group", 00:06:44.669 "iscsi_set_discovery_auth", 00:06:44.669 "iscsi_get_options", 00:06:44.669 "iscsi_target_node_request_logout", 00:06:44.669 "iscsi_target_node_set_redirect", 00:06:44.669 "iscsi_target_node_set_auth", 00:06:44.669 "iscsi_target_node_add_lun", 00:06:44.669 "iscsi_get_stats", 00:06:44.669 "iscsi_get_connections", 00:06:44.669 "iscsi_portal_group_set_auth", 00:06:44.669 "iscsi_start_portal_group", 00:06:44.669 "iscsi_delete_portal_group", 00:06:44.669 "iscsi_create_portal_group", 00:06:44.669 "iscsi_get_portal_groups", 00:06:44.669 "iscsi_delete_target_node", 00:06:44.669 "iscsi_target_node_remove_pg_ig_maps", 00:06:44.669 "iscsi_target_node_add_pg_ig_maps", 00:06:44.669 "iscsi_create_target_node", 00:06:44.669 "iscsi_get_target_nodes", 00:06:44.669 "iscsi_delete_initiator_group", 00:06:44.669 "iscsi_initiator_group_remove_initiators", 00:06:44.669 "iscsi_initiator_group_add_initiators", 00:06:44.669 "iscsi_create_initiator_group", 00:06:44.669 "iscsi_get_initiator_groups", 00:06:44.669 "nvmf_set_crdt", 00:06:44.669 "nvmf_set_config", 00:06:44.669 "nvmf_set_max_subsystems", 00:06:44.669 "nvmf_subsystem_get_listeners", 00:06:44.669 "nvmf_subsystem_get_qpairs", 00:06:44.669 "nvmf_subsystem_get_controllers", 00:06:44.669 "nvmf_get_stats", 00:06:44.669 "nvmf_get_transports", 00:06:44.669 "nvmf_create_transport", 00:06:44.669 "nvmf_get_targets", 00:06:44.669 "nvmf_delete_target", 00:06:44.669 "nvmf_create_target", 00:06:44.669 "nvmf_subsystem_allow_any_host", 00:06:44.669 "nvmf_subsystem_remove_host", 00:06:44.669 "nvmf_subsystem_add_host", 00:06:44.669 "nvmf_ns_remove_host", 00:06:44.669 "nvmf_ns_add_host", 00:06:44.669 "nvmf_subsystem_remove_ns", 00:06:44.669 "nvmf_subsystem_add_ns", 00:06:44.669 "nvmf_subsystem_listener_set_ana_state", 00:06:44.669 "nvmf_discovery_get_referrals", 00:06:44.669 "nvmf_discovery_remove_referral", 00:06:44.669 "nvmf_discovery_add_referral", 00:06:44.669 "nvmf_subsystem_remove_listener", 00:06:44.669 "nvmf_subsystem_add_listener", 00:06:44.669 "nvmf_delete_subsystem", 00:06:44.669 "nvmf_create_subsystem", 00:06:44.669 "nvmf_get_subsystems", 00:06:44.669 "env_dpdk_get_mem_stats", 00:06:44.669 "nbd_get_disks", 00:06:44.669 "nbd_stop_disk", 00:06:44.669 "nbd_start_disk", 00:06:44.669 "ublk_recover_disk", 00:06:44.669 "ublk_get_disks", 00:06:44.669 "ublk_stop_disk", 00:06:44.669 "ublk_start_disk", 00:06:44.669 "ublk_destroy_target", 00:06:44.669 "ublk_create_target", 00:06:44.669 "virtio_blk_create_transport", 00:06:44.669 "virtio_blk_get_transports", 00:06:44.669 "vhost_controller_set_coalescing", 00:06:44.669 "vhost_get_controllers", 00:06:44.669 "vhost_delete_controller", 00:06:44.669 "vhost_create_blk_controller", 00:06:44.669 "vhost_scsi_controller_remove_target", 00:06:44.669 "vhost_scsi_controller_add_target", 00:06:44.669 "vhost_start_scsi_controller", 00:06:44.669 "vhost_create_scsi_controller", 00:06:44.669 "thread_set_cpumask", 00:06:44.669 "framework_get_scheduler", 00:06:44.669 "framework_set_scheduler", 00:06:44.669 "framework_get_reactors", 00:06:44.669 "thread_get_io_channels", 00:06:44.669 "thread_get_pollers", 00:06:44.669 "thread_get_stats", 00:06:44.669 "framework_monitor_context_switch", 00:06:44.669 "spdk_kill_instance", 00:06:44.669 "log_enable_timestamps", 00:06:44.669 "log_get_flags", 00:06:44.669 "log_clear_flag", 00:06:44.669 "log_set_flag", 00:06:44.669 "log_get_level", 00:06:44.669 "log_set_level", 00:06:44.669 "log_get_print_level", 00:06:44.669 "log_set_print_level", 00:06:44.669 "framework_enable_cpumask_locks", 00:06:44.669 "framework_disable_cpumask_locks", 00:06:44.669 "framework_wait_init", 00:06:44.669 "framework_start_init", 00:06:44.669 "scsi_get_devices", 00:06:44.669 "bdev_get_histogram", 00:06:44.669 "bdev_enable_histogram", 00:06:44.669 "bdev_set_qos_limit", 00:06:44.669 "bdev_set_qd_sampling_period", 00:06:44.669 "bdev_get_bdevs", 00:06:44.669 "bdev_reset_iostat", 00:06:44.669 "bdev_get_iostat", 00:06:44.669 "bdev_examine", 00:06:44.669 "bdev_wait_for_examine", 00:06:44.669 "bdev_set_options", 00:06:44.669 "notify_get_notifications", 00:06:44.669 "notify_get_types", 00:06:44.669 "accel_get_stats", 00:06:44.669 "accel_set_options", 00:06:44.669 "accel_set_driver", 00:06:44.669 "accel_crypto_key_destroy", 00:06:44.670 "accel_crypto_keys_get", 00:06:44.670 "accel_crypto_key_create", 00:06:44.670 "accel_assign_opc", 00:06:44.670 "accel_get_module_info", 00:06:44.670 "accel_get_opc_assignments", 00:06:44.670 "vmd_rescan", 00:06:44.670 "vmd_remove_device", 00:06:44.670 "vmd_enable", 00:06:44.670 "sock_get_default_impl", 00:06:44.670 "sock_set_default_impl", 00:06:44.670 "sock_impl_set_options", 00:06:44.670 "sock_impl_get_options", 00:06:44.670 "iobuf_get_stats", 00:06:44.670 "iobuf_set_options", 00:06:44.670 "framework_get_pci_devices", 00:06:44.670 "framework_get_config", 00:06:44.670 "framework_get_subsystems", 00:06:44.670 "trace_get_info", 00:06:44.670 "trace_get_tpoint_group_mask", 00:06:44.670 "trace_disable_tpoint_group", 00:06:44.670 "trace_enable_tpoint_group", 00:06:44.670 "trace_clear_tpoint_mask", 00:06:44.670 "trace_set_tpoint_mask", 00:06:44.670 "keyring_get_keys", 00:06:44.670 "spdk_get_version", 00:06:44.670 "rpc_get_methods" 00:06:44.670 ] 00:06:44.670 00:40:51 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:44.670 00:40:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:06:44.670 00:40:51 -- common/autotest_common.sh@10 -- # set +x 00:06:44.670 00:40:51 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:44.670 00:40:51 -- spdkcli/tcp.sh@38 -- # killprocess 139537 00:06:44.670 00:40:51 -- common/autotest_common.sh@936 -- # '[' -z 139537 ']' 00:06:44.670 00:40:51 -- common/autotest_common.sh@940 -- # kill -0 139537 00:06:44.670 00:40:51 -- common/autotest_common.sh@941 -- # uname 00:06:44.670 00:40:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.670 00:40:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 139537 00:06:44.670 00:40:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.670 00:40:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.670 00:40:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 139537' 00:06:44.670 killing process with pid 139537 00:06:44.670 00:40:51 -- common/autotest_common.sh@955 -- # kill 139537 00:06:44.670 00:40:51 -- common/autotest_common.sh@960 -- # wait 139537 00:06:45.239 00:06:45.239 real 0m1.492s 00:06:45.239 user 0m2.749s 00:06:45.239 sys 0m0.419s 00:06:45.239 00:40:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:45.239 00:40:52 -- common/autotest_common.sh@10 -- # set +x 00:06:45.239 ************************************ 00:06:45.239 END TEST spdkcli_tcp 00:06:45.239 ************************************ 00:06:45.239 00:40:52 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:45.239 00:40:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.239 00:40:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.239 00:40:52 -- common/autotest_common.sh@10 -- # set +x 00:06:45.239 ************************************ 00:06:45.239 START TEST dpdk_mem_utility 00:06:45.239 ************************************ 00:06:45.239 00:40:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:45.239 * Looking for test storage... 00:06:45.239 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:06:45.239 00:40:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:45.239 00:40:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=139888 00:06:45.239 00:40:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 139888 00:06:45.239 00:40:52 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:06:45.239 00:40:52 -- common/autotest_common.sh@817 -- # '[' -z 139888 ']' 00:06:45.239 00:40:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.239 00:40:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:45.239 00:40:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.239 00:40:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:45.239 00:40:52 -- common/autotest_common.sh@10 -- # set +x 00:06:45.498 [2024-04-26 00:40:52.466887] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:45.498 [2024-04-26 00:40:52.466932] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid139888 ] 00:06:45.498 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.498 [2024-04-26 00:40:52.533260] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.498 [2024-04-26 00:40:52.598132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.065 00:40:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:46.065 00:40:53 -- common/autotest_common.sh@850 -- # return 0 00:06:46.065 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:46.065 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:46.065 00:40:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:46.065 00:40:53 -- common/autotest_common.sh@10 -- # set +x 00:06:46.065 { 00:06:46.065 "filename": "/tmp/spdk_mem_dump.txt" 00:06:46.065 } 00:06:46.065 00:40:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:46.065 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:46.325 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:46.325 1 heaps totaling size 814.000000 MiB 00:06:46.325 size: 814.000000 MiB heap id: 0 00:06:46.325 end heaps---------- 00:06:46.325 8 mempools totaling size 598.116089 MiB 00:06:46.325 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:46.325 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:46.325 size: 84.521057 MiB name: bdev_io_139888 00:06:46.325 size: 51.011292 MiB name: evtpool_139888 00:06:46.325 size: 50.003479 MiB name: msgpool_139888 00:06:46.325 size: 21.763794 MiB name: PDU_Pool 00:06:46.325 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:46.325 size: 0.026123 MiB name: Session_Pool 00:06:46.325 end mempools------- 00:06:46.325 6 memzones totaling size 4.142822 MiB 00:06:46.325 size: 1.000366 MiB name: RG_ring_0_139888 00:06:46.325 size: 1.000366 MiB name: RG_ring_1_139888 00:06:46.325 size: 1.000366 MiB name: RG_ring_4_139888 00:06:46.325 size: 1.000366 MiB name: RG_ring_5_139888 00:06:46.325 size: 0.125366 MiB name: RG_ring_2_139888 00:06:46.325 size: 0.015991 MiB name: RG_ring_3_139888 00:06:46.325 end memzones------- 00:06:46.325 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:46.325 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:46.325 list of free elements. size: 12.519348 MiB 00:06:46.325 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:46.325 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:46.325 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:46.325 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:46.325 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:46.325 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:46.325 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:46.325 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:46.325 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:46.325 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:46.325 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:46.325 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:46.325 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:46.325 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:46.325 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:46.325 list of standard malloc elements. size: 199.218079 MiB 00:06:46.325 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:46.326 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:46.326 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:46.326 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:46.326 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:46.326 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:46.326 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:46.326 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:46.326 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:46.326 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:46.326 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:46.326 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:46.326 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:46.326 list of memzone associated elements. size: 602.262573 MiB 00:06:46.326 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:46.326 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:46.326 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:46.326 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:46.326 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:46.326 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_139888_0 00:06:46.326 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:46.326 associated memzone info: size: 48.002930 MiB name: MP_evtpool_139888_0 00:06:46.326 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:46.326 associated memzone info: size: 48.002930 MiB name: MP_msgpool_139888_0 00:06:46.326 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:46.326 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:46.326 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:46.326 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:46.326 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:46.326 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_139888 00:06:46.326 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:46.326 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_139888 00:06:46.326 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:46.326 associated memzone info: size: 1.007996 MiB name: MP_evtpool_139888 00:06:46.326 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:46.326 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:46.326 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:46.326 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:46.326 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:46.326 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:46.326 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:46.326 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:46.326 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:46.326 associated memzone info: size: 1.000366 MiB name: RG_ring_0_139888 00:06:46.326 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:46.326 associated memzone info: size: 1.000366 MiB name: RG_ring_1_139888 00:06:46.326 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:46.326 associated memzone info: size: 1.000366 MiB name: RG_ring_4_139888 00:06:46.326 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:46.326 associated memzone info: size: 1.000366 MiB name: RG_ring_5_139888 00:06:46.326 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:46.326 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_139888 00:06:46.326 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:46.326 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:46.326 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:46.326 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:46.326 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:46.326 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:46.326 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:46.326 associated memzone info: size: 0.125366 MiB name: RG_ring_2_139888 00:06:46.326 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:46.326 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:46.326 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:46.326 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:46.326 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:46.326 associated memzone info: size: 0.015991 MiB name: RG_ring_3_139888 00:06:46.326 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:46.326 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:46.326 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:46.326 associated memzone info: size: 0.000183 MiB name: MP_msgpool_139888 00:06:46.326 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:46.326 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_139888 00:06:46.326 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:46.326 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:46.326 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:46.326 00:40:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 139888 00:06:46.326 00:40:53 -- common/autotest_common.sh@936 -- # '[' -z 139888 ']' 00:06:46.326 00:40:53 -- common/autotest_common.sh@940 -- # kill -0 139888 00:06:46.326 00:40:53 -- common/autotest_common.sh@941 -- # uname 00:06:46.326 00:40:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:46.326 00:40:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 139888 00:06:46.326 00:40:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:46.326 00:40:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:46.326 00:40:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 139888' 00:06:46.326 killing process with pid 139888 00:06:46.326 00:40:53 -- common/autotest_common.sh@955 -- # kill 139888 00:06:46.326 00:40:53 -- common/autotest_common.sh@960 -- # wait 139888 00:06:46.586 00:06:46.586 real 0m1.378s 00:06:46.586 user 0m1.422s 00:06:46.586 sys 0m0.389s 00:06:46.586 00:40:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:46.586 00:40:53 -- common/autotest_common.sh@10 -- # set +x 00:06:46.586 ************************************ 00:06:46.586 END TEST dpdk_mem_utility 00:06:46.586 ************************************ 00:06:46.586 00:40:53 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:06:46.586 00:40:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:46.586 00:40:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.586 00:40:53 -- common/autotest_common.sh@10 -- # set +x 00:06:46.845 ************************************ 00:06:46.845 START TEST event 00:06:46.845 ************************************ 00:06:46.845 00:40:53 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:06:46.845 * Looking for test storage... 00:06:46.845 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:06:46.845 00:40:53 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:46.845 00:40:53 -- bdev/nbd_common.sh@6 -- # set -e 00:06:46.845 00:40:53 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:46.845 00:40:53 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:46.845 00:40:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.845 00:40:53 -- common/autotest_common.sh@10 -- # set +x 00:06:47.105 ************************************ 00:06:47.105 START TEST event_perf 00:06:47.105 ************************************ 00:06:47.105 00:40:54 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:47.105 Running I/O for 1 seconds...[2024-04-26 00:40:54.128299] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:47.105 [2024-04-26 00:40:54.128356] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid140223 ] 00:06:47.105 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.105 [2024-04-26 00:40:54.197955] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:47.105 [2024-04-26 00:40:54.266121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:47.105 [2024-04-26 00:40:54.266230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:47.105 [2024-04-26 00:40:54.266367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.105 [2024-04-26 00:40:54.266368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:48.483 Running I/O for 1 seconds... 00:06:48.483 lcore 0: 218477 00:06:48.483 lcore 1: 218476 00:06:48.483 lcore 2: 218477 00:06:48.483 lcore 3: 218477 00:06:48.483 done. 00:06:48.483 00:06:48.483 real 0m1.242s 00:06:48.483 user 0m4.152s 00:06:48.483 sys 0m0.087s 00:06:48.483 00:40:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:48.483 00:40:55 -- common/autotest_common.sh@10 -- # set +x 00:06:48.483 ************************************ 00:06:48.483 END TEST event_perf 00:06:48.483 ************************************ 00:06:48.483 00:40:55 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:48.483 00:40:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:48.483 00:40:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.483 00:40:55 -- common/autotest_common.sh@10 -- # set +x 00:06:48.483 ************************************ 00:06:48.484 START TEST event_reactor 00:06:48.484 ************************************ 00:06:48.484 00:40:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:48.484 [2024-04-26 00:40:55.526124] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:48.484 [2024-04-26 00:40:55.526186] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid140513 ] 00:06:48.484 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.484 [2024-04-26 00:40:55.597747] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.484 [2024-04-26 00:40:55.670733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.862 test_start 00:06:49.862 oneshot 00:06:49.862 tick 100 00:06:49.862 tick 100 00:06:49.862 tick 250 00:06:49.862 tick 100 00:06:49.862 tick 100 00:06:49.862 tick 100 00:06:49.862 tick 250 00:06:49.862 tick 500 00:06:49.862 tick 100 00:06:49.862 tick 100 00:06:49.862 tick 250 00:06:49.862 tick 100 00:06:49.862 tick 100 00:06:49.862 test_end 00:06:49.862 00:06:49.862 real 0m1.245s 00:06:49.862 user 0m1.158s 00:06:49.862 sys 0m0.082s 00:06:49.862 00:40:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:49.862 00:40:56 -- common/autotest_common.sh@10 -- # set +x 00:06:49.862 ************************************ 00:06:49.862 END TEST event_reactor 00:06:49.862 ************************************ 00:06:49.862 00:40:56 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:49.862 00:40:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:49.862 00:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.862 00:40:56 -- common/autotest_common.sh@10 -- # set +x 00:06:49.862 ************************************ 00:06:49.862 START TEST event_reactor_perf 00:06:49.862 ************************************ 00:06:49.862 00:40:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:49.862 [2024-04-26 00:40:56.937122] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:49.862 [2024-04-26 00:40:56.937190] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid140800 ] 00:06:49.862 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.862 [2024-04-26 00:40:57.010383] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.121 [2024-04-26 00:40:57.087585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.058 test_start 00:06:51.058 test_end 00:06:51.058 Performance: 558609 events per second 00:06:51.058 00:06:51.058 real 0m1.250s 00:06:51.058 user 0m1.162s 00:06:51.058 sys 0m0.084s 00:06:51.058 00:40:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:51.058 00:40:58 -- common/autotest_common.sh@10 -- # set +x 00:06:51.058 ************************************ 00:06:51.058 END TEST event_reactor_perf 00:06:51.058 ************************************ 00:06:51.058 00:40:58 -- event/event.sh@49 -- # uname -s 00:06:51.058 00:40:58 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:51.058 00:40:58 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:51.058 00:40:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:51.058 00:40:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.058 00:40:58 -- common/autotest_common.sh@10 -- # set +x 00:06:51.318 ************************************ 00:06:51.318 START TEST event_scheduler 00:06:51.318 ************************************ 00:06:51.318 00:40:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:51.318 * Looking for test storage... 00:06:51.318 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:06:51.318 00:40:58 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:51.318 00:40:58 -- scheduler/scheduler.sh@35 -- # scheduler_pid=141125 00:06:51.318 00:40:58 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:51.318 00:40:58 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:51.318 00:40:58 -- scheduler/scheduler.sh@37 -- # waitforlisten 141125 00:06:51.318 00:40:58 -- common/autotest_common.sh@817 -- # '[' -z 141125 ']' 00:06:51.318 00:40:58 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:51.318 00:40:58 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:51.318 00:40:58 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:51.318 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:51.318 00:40:58 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:51.318 00:40:58 -- common/autotest_common.sh@10 -- # set +x 00:06:51.318 [2024-04-26 00:40:58.459825] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:51.318 [2024-04-26 00:40:58.459874] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid141125 ] 00:06:51.318 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.577 [2024-04-26 00:40:58.525561] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:51.577 [2024-04-26 00:40:58.598462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.577 [2024-04-26 00:40:58.598487] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:51.577 [2024-04-26 00:40:58.598591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:51.577 [2024-04-26 00:40:58.598591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:52.145 00:40:59 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:52.145 00:40:59 -- common/autotest_common.sh@850 -- # return 0 00:06:52.145 00:40:59 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:52.145 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.145 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.145 POWER: Env isn't set yet! 00:06:52.145 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:52.145 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:06:52.145 POWER: Cannot set governor of lcore 0 to userspace 00:06:52.145 POWER: Attempting to initialise PSTAT power management... 00:06:52.145 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:52.145 POWER: Initialized successfully for lcore 0 power management 00:06:52.145 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:52.145 POWER: Initialized successfully for lcore 1 power management 00:06:52.145 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:52.145 POWER: Initialized successfully for lcore 2 power management 00:06:52.145 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:52.145 POWER: Initialized successfully for lcore 3 power management 00:06:52.145 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.145 00:40:59 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:52.145 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.145 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.404 [2024-04-26 00:40:59.344512] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:52.404 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.404 00:40:59 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:52.404 00:40:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:52.404 00:40:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.404 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.404 ************************************ 00:06:52.404 START TEST scheduler_create_thread 00:06:52.404 ************************************ 00:06:52.404 00:40:59 -- common/autotest_common.sh@1111 -- # scheduler_create_thread 00:06:52.404 00:40:59 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:52.404 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.404 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.404 2 00:06:52.404 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.404 00:40:59 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:52.404 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.404 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.404 3 00:06:52.404 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 4 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 5 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 6 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 7 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 8 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 9 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 10 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:52.405 00:40:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:52.405 00:40:59 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:52.405 00:40:59 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:52.405 00:40:59 -- common/autotest_common.sh@10 -- # set +x 00:06:53.339 00:41:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:53.339 00:41:00 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:53.339 00:41:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:53.339 00:41:00 -- common/autotest_common.sh@10 -- # set +x 00:06:54.716 00:41:01 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:54.716 00:41:01 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:54.716 00:41:01 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:54.716 00:41:01 -- common/autotest_common.sh@549 -- # xtrace_disable 00:06:54.716 00:41:01 -- common/autotest_common.sh@10 -- # set +x 00:06:56.095 00:41:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:06:56.095 00:06:56.095 real 0m3.483s 00:06:56.095 user 0m0.021s 00:06:56.095 sys 0m0.007s 00:06:56.095 00:41:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.095 00:41:02 -- common/autotest_common.sh@10 -- # set +x 00:06:56.095 ************************************ 00:06:56.095 END TEST scheduler_create_thread 00:06:56.095 ************************************ 00:06:56.095 00:41:02 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:56.095 00:41:02 -- scheduler/scheduler.sh@46 -- # killprocess 141125 00:06:56.096 00:41:02 -- common/autotest_common.sh@936 -- # '[' -z 141125 ']' 00:06:56.096 00:41:02 -- common/autotest_common.sh@940 -- # kill -0 141125 00:06:56.096 00:41:02 -- common/autotest_common.sh@941 -- # uname 00:06:56.096 00:41:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:56.096 00:41:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 141125 00:06:56.096 00:41:03 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:56.096 00:41:03 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:56.096 00:41:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 141125' 00:06:56.096 killing process with pid 141125 00:06:56.096 00:41:03 -- common/autotest_common.sh@955 -- # kill 141125 00:06:56.096 00:41:03 -- common/autotest_common.sh@960 -- # wait 141125 00:06:56.355 [2024-04-26 00:41:03.445269] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:56.355 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:06:56.355 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:56.355 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:06:56.355 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:56.355 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:06:56.355 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:56.355 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:06:56.355 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:56.615 00:06:56.615 real 0m5.309s 00:06:56.615 user 0m8.617s 00:06:56.615 sys 0m0.435s 00:06:56.615 00:41:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:06:56.615 00:41:03 -- common/autotest_common.sh@10 -- # set +x 00:06:56.615 ************************************ 00:06:56.615 END TEST event_scheduler 00:06:56.615 ************************************ 00:06:56.615 00:41:03 -- event/event.sh@51 -- # modprobe -n nbd 00:06:56.615 00:41:03 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:56.615 00:41:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:56.615 00:41:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.615 00:41:03 -- common/autotest_common.sh@10 -- # set +x 00:06:56.615 ************************************ 00:06:56.615 START TEST app_repeat 00:06:56.615 ************************************ 00:06:56.615 00:41:03 -- common/autotest_common.sh@1111 -- # app_repeat_test 00:06:56.615 00:41:03 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:56.615 00:41:03 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:56.615 00:41:03 -- event/event.sh@13 -- # local nbd_list 00:06:56.615 00:41:03 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:56.615 00:41:03 -- event/event.sh@14 -- # local bdev_list 00:06:56.615 00:41:03 -- event/event.sh@15 -- # local repeat_times=4 00:06:56.615 00:41:03 -- event/event.sh@17 -- # modprobe nbd 00:06:56.615 00:41:03 -- event/event.sh@19 -- # repeat_pid=142231 00:06:56.615 00:41:03 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:56.615 00:41:03 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:56.615 00:41:03 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 142231' 00:06:56.615 Process app_repeat pid: 142231 00:06:56.615 00:41:03 -- event/event.sh@23 -- # for i in {0..2} 00:06:56.615 00:41:03 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:56.615 spdk_app_start Round 0 00:06:56.615 00:41:03 -- event/event.sh@25 -- # waitforlisten 142231 /var/tmp/spdk-nbd.sock 00:06:56.615 00:41:03 -- common/autotest_common.sh@817 -- # '[' -z 142231 ']' 00:06:56.615 00:41:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:56.615 00:41:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:06:56.615 00:41:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:56.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:56.615 00:41:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:06:56.615 00:41:03 -- common/autotest_common.sh@10 -- # set +x 00:06:56.875 [2024-04-26 00:41:03.821444] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:06:56.875 [2024-04-26 00:41:03.821492] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid142231 ] 00:06:56.875 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.875 [2024-04-26 00:41:03.873753] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:56.875 [2024-04-26 00:41:03.945974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:56.875 [2024-04-26 00:41:03.945977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.442 00:41:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:06:57.442 00:41:04 -- common/autotest_common.sh@850 -- # return 0 00:06:57.442 00:41:04 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:57.700 Malloc0 00:06:57.700 00:41:04 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:57.959 Malloc1 00:06:57.959 00:41:04 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@12 -- # local i 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:57.959 00:41:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:57.959 /dev/nbd0 00:06:57.959 00:41:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:57.959 00:41:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:57.959 00:41:05 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:06:57.959 00:41:05 -- common/autotest_common.sh@855 -- # local i 00:06:57.959 00:41:05 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:57.959 00:41:05 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:57.959 00:41:05 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:06:57.959 00:41:05 -- common/autotest_common.sh@859 -- # break 00:06:57.959 00:41:05 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:57.959 00:41:05 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:57.959 00:41:05 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:57.959 1+0 records in 00:06:57.959 1+0 records out 00:06:57.959 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000185314 s, 22.1 MB/s 00:06:57.959 00:41:05 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:57.959 00:41:05 -- common/autotest_common.sh@872 -- # size=4096 00:06:57.959 00:41:05 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:58.218 00:41:05 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:58.218 00:41:05 -- common/autotest_common.sh@875 -- # return 0 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:58.218 /dev/nbd1 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:58.218 00:41:05 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:06:58.218 00:41:05 -- common/autotest_common.sh@855 -- # local i 00:06:58.218 00:41:05 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:06:58.218 00:41:05 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:06:58.218 00:41:05 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:06:58.218 00:41:05 -- common/autotest_common.sh@859 -- # break 00:06:58.218 00:41:05 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:06:58.218 00:41:05 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:06:58.218 00:41:05 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:58.218 1+0 records in 00:06:58.218 1+0 records out 00:06:58.218 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000231194 s, 17.7 MB/s 00:06:58.218 00:41:05 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:58.218 00:41:05 -- common/autotest_common.sh@872 -- # size=4096 00:06:58.218 00:41:05 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:58.218 00:41:05 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:06:58.218 00:41:05 -- common/autotest_common.sh@875 -- # return 0 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.218 00:41:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:58.477 { 00:06:58.477 "nbd_device": "/dev/nbd0", 00:06:58.477 "bdev_name": "Malloc0" 00:06:58.477 }, 00:06:58.477 { 00:06:58.477 "nbd_device": "/dev/nbd1", 00:06:58.477 "bdev_name": "Malloc1" 00:06:58.477 } 00:06:58.477 ]' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:58.477 { 00:06:58.477 "nbd_device": "/dev/nbd0", 00:06:58.477 "bdev_name": "Malloc0" 00:06:58.477 }, 00:06:58.477 { 00:06:58.477 "nbd_device": "/dev/nbd1", 00:06:58.477 "bdev_name": "Malloc1" 00:06:58.477 } 00:06:58.477 ]' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:58.477 /dev/nbd1' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:58.477 /dev/nbd1' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@65 -- # count=2 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@95 -- # count=2 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:58.477 256+0 records in 00:06:58.477 256+0 records out 00:06:58.477 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101134 s, 104 MB/s 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:58.477 256+0 records in 00:06:58.477 256+0 records out 00:06:58.477 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123388 s, 85.0 MB/s 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:58.477 256+0 records in 00:06:58.477 256+0 records out 00:06:58.477 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134569 s, 77.9 MB/s 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:58.477 00:41:05 -- bdev/nbd_common.sh@51 -- # local i 00:06:58.478 00:41:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:58.478 00:41:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@41 -- # break 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@45 -- # return 0 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:58.735 00:41:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@41 -- # break 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@45 -- # return 0 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:58.993 00:41:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@65 -- # true 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@65 -- # count=0 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@104 -- # count=0 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:58.993 00:41:06 -- bdev/nbd_common.sh@109 -- # return 0 00:06:58.993 00:41:06 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:59.251 00:41:06 -- event/event.sh@35 -- # sleep 3 00:06:59.510 [2024-04-26 00:41:06.549001] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:59.510 [2024-04-26 00:41:06.607771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:59.510 [2024-04-26 00:41:06.607774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.510 [2024-04-26 00:41:06.648391] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:59.510 [2024-04-26 00:41:06.648431] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:02.792 00:41:09 -- event/event.sh@23 -- # for i in {0..2} 00:07:02.792 00:41:09 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:07:02.792 spdk_app_start Round 1 00:07:02.792 00:41:09 -- event/event.sh@25 -- # waitforlisten 142231 /var/tmp/spdk-nbd.sock 00:07:02.792 00:41:09 -- common/autotest_common.sh@817 -- # '[' -z 142231 ']' 00:07:02.792 00:41:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:02.792 00:41:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:02.792 00:41:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:02.792 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:02.792 00:41:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:02.792 00:41:09 -- common/autotest_common.sh@10 -- # set +x 00:07:02.792 00:41:09 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:02.792 00:41:09 -- common/autotest_common.sh@850 -- # return 0 00:07:02.792 00:41:09 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:02.792 Malloc0 00:07:02.792 00:41:09 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:02.792 Malloc1 00:07:02.792 00:41:09 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@12 -- # local i 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:02.792 00:41:09 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:03.051 /dev/nbd0 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:03.051 00:41:10 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:07:03.051 00:41:10 -- common/autotest_common.sh@855 -- # local i 00:07:03.051 00:41:10 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:03.051 00:41:10 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:03.051 00:41:10 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:07:03.051 00:41:10 -- common/autotest_common.sh@859 -- # break 00:07:03.051 00:41:10 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:03.051 00:41:10 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:03.051 00:41:10 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:03.051 1+0 records in 00:07:03.051 1+0 records out 00:07:03.051 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000228124 s, 18.0 MB/s 00:07:03.051 00:41:10 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:03.051 00:41:10 -- common/autotest_common.sh@872 -- # size=4096 00:07:03.051 00:41:10 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:03.051 00:41:10 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:03.051 00:41:10 -- common/autotest_common.sh@875 -- # return 0 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:03.051 /dev/nbd1 00:07:03.051 00:41:10 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:03.309 00:41:10 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:07:03.309 00:41:10 -- common/autotest_common.sh@855 -- # local i 00:07:03.309 00:41:10 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:03.309 00:41:10 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:03.309 00:41:10 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:07:03.309 00:41:10 -- common/autotest_common.sh@859 -- # break 00:07:03.309 00:41:10 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:03.309 00:41:10 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:03.309 00:41:10 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:03.309 1+0 records in 00:07:03.309 1+0 records out 00:07:03.309 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000182762 s, 22.4 MB/s 00:07:03.309 00:41:10 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:03.309 00:41:10 -- common/autotest_common.sh@872 -- # size=4096 00:07:03.309 00:41:10 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:03.309 00:41:10 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:03.309 00:41:10 -- common/autotest_common.sh@875 -- # return 0 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:03.309 { 00:07:03.309 "nbd_device": "/dev/nbd0", 00:07:03.309 "bdev_name": "Malloc0" 00:07:03.309 }, 00:07:03.309 { 00:07:03.309 "nbd_device": "/dev/nbd1", 00:07:03.309 "bdev_name": "Malloc1" 00:07:03.309 } 00:07:03.309 ]' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:03.309 { 00:07:03.309 "nbd_device": "/dev/nbd0", 00:07:03.309 "bdev_name": "Malloc0" 00:07:03.309 }, 00:07:03.309 { 00:07:03.309 "nbd_device": "/dev/nbd1", 00:07:03.309 "bdev_name": "Malloc1" 00:07:03.309 } 00:07:03.309 ]' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:03.309 /dev/nbd1' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:03.309 /dev/nbd1' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@65 -- # count=2 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@95 -- # count=2 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:03.309 256+0 records in 00:07:03.309 256+0 records out 00:07:03.309 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008251 s, 127 MB/s 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:03.309 00:41:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:03.567 256+0 records in 00:07:03.567 256+0 records out 00:07:03.567 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128606 s, 81.5 MB/s 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:03.567 256+0 records in 00:07:03.567 256+0 records out 00:07:03.567 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132722 s, 79.0 MB/s 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:03.567 00:41:10 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@51 -- # local i 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@41 -- # break 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@45 -- # return 0 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:03.568 00:41:10 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@41 -- # break 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@45 -- # return 0 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:03.826 00:41:10 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@65 -- # true 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@65 -- # count=0 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@104 -- # count=0 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:04.086 00:41:11 -- bdev/nbd_common.sh@109 -- # return 0 00:07:04.086 00:41:11 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:04.086 00:41:11 -- event/event.sh@35 -- # sleep 3 00:07:04.344 [2024-04-26 00:41:11.470427] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:04.344 [2024-04-26 00:41:11.529793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:04.344 [2024-04-26 00:41:11.529796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.603 [2024-04-26 00:41:11.571360] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:04.603 [2024-04-26 00:41:11.571401] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:07.139 00:41:14 -- event/event.sh@23 -- # for i in {0..2} 00:07:07.139 00:41:14 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:07:07.139 spdk_app_start Round 2 00:07:07.139 00:41:14 -- event/event.sh@25 -- # waitforlisten 142231 /var/tmp/spdk-nbd.sock 00:07:07.139 00:41:14 -- common/autotest_common.sh@817 -- # '[' -z 142231 ']' 00:07:07.139 00:41:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:07.139 00:41:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:07.139 00:41:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:07.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:07.139 00:41:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:07.139 00:41:14 -- common/autotest_common.sh@10 -- # set +x 00:07:07.398 00:41:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:07.398 00:41:14 -- common/autotest_common.sh@850 -- # return 0 00:07:07.398 00:41:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:07.657 Malloc0 00:07:07.657 00:41:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:07:07.657 Malloc1 00:07:07.657 00:41:14 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@12 -- # local i 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:07.657 00:41:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:07:07.916 /dev/nbd0 00:07:07.916 00:41:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:07:07.916 00:41:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:07:07.916 00:41:14 -- common/autotest_common.sh@854 -- # local nbd_name=nbd0 00:07:07.916 00:41:14 -- common/autotest_common.sh@855 -- # local i 00:07:07.916 00:41:14 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:07.916 00:41:14 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:07.916 00:41:14 -- common/autotest_common.sh@858 -- # grep -q -w nbd0 /proc/partitions 00:07:07.916 00:41:14 -- common/autotest_common.sh@859 -- # break 00:07:07.916 00:41:14 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:07.916 00:41:14 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:07.916 00:41:14 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:07.916 1+0 records in 00:07:07.916 1+0 records out 00:07:07.916 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000177141 s, 23.1 MB/s 00:07:07.916 00:41:14 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:07.916 00:41:14 -- common/autotest_common.sh@872 -- # size=4096 00:07:07.916 00:41:14 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:07.916 00:41:14 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:07.916 00:41:14 -- common/autotest_common.sh@875 -- # return 0 00:07:07.916 00:41:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:07.916 00:41:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:07.916 00:41:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:07:07.916 /dev/nbd1 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:07:08.176 00:41:15 -- common/autotest_common.sh@854 -- # local nbd_name=nbd1 00:07:08.176 00:41:15 -- common/autotest_common.sh@855 -- # local i 00:07:08.176 00:41:15 -- common/autotest_common.sh@857 -- # (( i = 1 )) 00:07:08.176 00:41:15 -- common/autotest_common.sh@857 -- # (( i <= 20 )) 00:07:08.176 00:41:15 -- common/autotest_common.sh@858 -- # grep -q -w nbd1 /proc/partitions 00:07:08.176 00:41:15 -- common/autotest_common.sh@859 -- # break 00:07:08.176 00:41:15 -- common/autotest_common.sh@870 -- # (( i = 1 )) 00:07:08.176 00:41:15 -- common/autotest_common.sh@870 -- # (( i <= 20 )) 00:07:08.176 00:41:15 -- common/autotest_common.sh@871 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:07:08.176 1+0 records in 00:07:08.176 1+0 records out 00:07:08.176 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000193135 s, 21.2 MB/s 00:07:08.176 00:41:15 -- common/autotest_common.sh@872 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:08.176 00:41:15 -- common/autotest_common.sh@872 -- # size=4096 00:07:08.176 00:41:15 -- common/autotest_common.sh@873 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:07:08.176 00:41:15 -- common/autotest_common.sh@874 -- # '[' 4096 '!=' 0 ']' 00:07:08.176 00:41:15 -- common/autotest_common.sh@875 -- # return 0 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:07:08.176 { 00:07:08.176 "nbd_device": "/dev/nbd0", 00:07:08.176 "bdev_name": "Malloc0" 00:07:08.176 }, 00:07:08.176 { 00:07:08.176 "nbd_device": "/dev/nbd1", 00:07:08.176 "bdev_name": "Malloc1" 00:07:08.176 } 00:07:08.176 ]' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:07:08.176 { 00:07:08.176 "nbd_device": "/dev/nbd0", 00:07:08.176 "bdev_name": "Malloc0" 00:07:08.176 }, 00:07:08.176 { 00:07:08.176 "nbd_device": "/dev/nbd1", 00:07:08.176 "bdev_name": "Malloc1" 00:07:08.176 } 00:07:08.176 ]' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:07:08.176 /dev/nbd1' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:07:08.176 /dev/nbd1' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@65 -- # count=2 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@95 -- # count=2 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:07:08.176 256+0 records in 00:07:08.176 256+0 records out 00:07:08.176 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103167 s, 102 MB/s 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:08.176 00:41:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:07:08.435 256+0 records in 00:07:08.435 256+0 records out 00:07:08.435 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01319 s, 79.5 MB/s 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:07:08.435 256+0 records in 00:07:08.435 256+0 records out 00:07:08.435 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144366 s, 72.6 MB/s 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@51 -- # local i 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@41 -- # break 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@45 -- # return 0 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:07:08.435 00:41:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@41 -- # break 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@45 -- # return 0 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:07:08.694 00:41:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@65 -- # true 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@65 -- # count=0 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@104 -- # count=0 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:07:08.954 00:41:15 -- bdev/nbd_common.sh@109 -- # return 0 00:07:08.954 00:41:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:07:08.954 00:41:16 -- event/event.sh@35 -- # sleep 3 00:07:09.214 [2024-04-26 00:41:16.343345] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:07:09.214 [2024-04-26 00:41:16.401648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:09.214 [2024-04-26 00:41:16.401650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.473 [2024-04-26 00:41:16.441712] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:07:09.473 [2024-04-26 00:41:16.441750] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:07:12.010 00:41:19 -- event/event.sh@38 -- # waitforlisten 142231 /var/tmp/spdk-nbd.sock 00:07:12.010 00:41:19 -- common/autotest_common.sh@817 -- # '[' -z 142231 ']' 00:07:12.010 00:41:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:07:12.010 00:41:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:12.010 00:41:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:07:12.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:07:12.010 00:41:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:12.010 00:41:19 -- common/autotest_common.sh@10 -- # set +x 00:07:12.269 00:41:19 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:12.269 00:41:19 -- common/autotest_common.sh@850 -- # return 0 00:07:12.269 00:41:19 -- event/event.sh@39 -- # killprocess 142231 00:07:12.269 00:41:19 -- common/autotest_common.sh@936 -- # '[' -z 142231 ']' 00:07:12.269 00:41:19 -- common/autotest_common.sh@940 -- # kill -0 142231 00:07:12.270 00:41:19 -- common/autotest_common.sh@941 -- # uname 00:07:12.270 00:41:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:12.270 00:41:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 142231 00:07:12.270 00:41:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:12.270 00:41:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:12.270 00:41:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 142231' 00:07:12.270 killing process with pid 142231 00:07:12.270 00:41:19 -- common/autotest_common.sh@955 -- # kill 142231 00:07:12.270 00:41:19 -- common/autotest_common.sh@960 -- # wait 142231 00:07:12.529 spdk_app_start is called in Round 0. 00:07:12.529 Shutdown signal received, stop current app iteration 00:07:12.529 Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 reinitialization... 00:07:12.529 spdk_app_start is called in Round 1. 00:07:12.529 Shutdown signal received, stop current app iteration 00:07:12.529 Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 reinitialization... 00:07:12.529 spdk_app_start is called in Round 2. 00:07:12.529 Shutdown signal received, stop current app iteration 00:07:12.529 Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 reinitialization... 00:07:12.529 spdk_app_start is called in Round 3. 00:07:12.529 Shutdown signal received, stop current app iteration 00:07:12.529 00:41:19 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:07:12.529 00:41:19 -- event/event.sh@42 -- # return 0 00:07:12.529 00:07:12.529 real 0m15.736s 00:07:12.529 user 0m33.819s 00:07:12.529 sys 0m2.192s 00:07:12.529 00:41:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:12.529 00:41:19 -- common/autotest_common.sh@10 -- # set +x 00:07:12.529 ************************************ 00:07:12.529 END TEST app_repeat 00:07:12.529 ************************************ 00:07:12.529 00:41:19 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:07:12.529 00:41:19 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:12.529 00:41:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:12.529 00:41:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.529 00:41:19 -- common/autotest_common.sh@10 -- # set +x 00:07:12.529 ************************************ 00:07:12.529 START TEST cpu_locks 00:07:12.529 ************************************ 00:07:12.529 00:41:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:07:12.789 * Looking for test storage... 00:07:12.789 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:07:12.789 00:41:19 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:07:12.789 00:41:19 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:07:12.789 00:41:19 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:07:12.789 00:41:19 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:07:12.789 00:41:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:12.789 00:41:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.789 00:41:19 -- common/autotest_common.sh@10 -- # set +x 00:07:12.789 ************************************ 00:07:12.789 START TEST default_locks 00:07:12.789 ************************************ 00:07:12.789 00:41:19 -- common/autotest_common.sh@1111 -- # default_locks 00:07:12.789 00:41:19 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=145378 00:07:12.789 00:41:19 -- event/cpu_locks.sh@47 -- # waitforlisten 145378 00:07:12.789 00:41:19 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:12.789 00:41:19 -- common/autotest_common.sh@817 -- # '[' -z 145378 ']' 00:07:12.789 00:41:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.789 00:41:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:12.789 00:41:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.789 00:41:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:12.789 00:41:19 -- common/autotest_common.sh@10 -- # set +x 00:07:12.789 [2024-04-26 00:41:19.968119] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:12.789 [2024-04-26 00:41:19.968156] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid145378 ] 00:07:13.048 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.048 [2024-04-26 00:41:20.018798] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.048 [2024-04-26 00:41:20.098172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.616 00:41:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:13.616 00:41:20 -- common/autotest_common.sh@850 -- # return 0 00:07:13.616 00:41:20 -- event/cpu_locks.sh@49 -- # locks_exist 145378 00:07:13.616 00:41:20 -- event/cpu_locks.sh@22 -- # lslocks -p 145378 00:07:13.616 00:41:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:13.875 lslocks: write error 00:07:13.875 00:41:20 -- event/cpu_locks.sh@50 -- # killprocess 145378 00:07:13.875 00:41:20 -- common/autotest_common.sh@936 -- # '[' -z 145378 ']' 00:07:13.875 00:41:20 -- common/autotest_common.sh@940 -- # kill -0 145378 00:07:13.875 00:41:20 -- common/autotest_common.sh@941 -- # uname 00:07:13.875 00:41:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:13.875 00:41:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 145378 00:07:13.875 00:41:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:13.875 00:41:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:13.875 00:41:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 145378' 00:07:13.875 killing process with pid 145378 00:07:13.875 00:41:20 -- common/autotest_common.sh@955 -- # kill 145378 00:07:13.875 00:41:20 -- common/autotest_common.sh@960 -- # wait 145378 00:07:14.134 00:41:21 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 145378 00:07:14.134 00:41:21 -- common/autotest_common.sh@638 -- # local es=0 00:07:14.134 00:41:21 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 145378 00:07:14.134 00:41:21 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:14.134 00:41:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:14.134 00:41:21 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:14.134 00:41:21 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:14.134 00:41:21 -- common/autotest_common.sh@641 -- # waitforlisten 145378 00:07:14.134 00:41:21 -- common/autotest_common.sh@817 -- # '[' -z 145378 ']' 00:07:14.134 00:41:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:14.134 00:41:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:14.134 00:41:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:14.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:14.134 00:41:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:14.134 00:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:14.134 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (145378) - No such process 00:07:14.134 ERROR: process (pid: 145378) is no longer running 00:07:14.134 00:41:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:14.134 00:41:21 -- common/autotest_common.sh@850 -- # return 1 00:07:14.134 00:41:21 -- common/autotest_common.sh@641 -- # es=1 00:07:14.134 00:41:21 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:14.134 00:41:21 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:14.134 00:41:21 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:14.134 00:41:21 -- event/cpu_locks.sh@54 -- # no_locks 00:07:14.134 00:41:21 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:14.134 00:41:21 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:14.134 00:41:21 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:14.134 00:07:14.134 real 0m1.307s 00:07:14.134 user 0m1.357s 00:07:14.134 sys 0m0.384s 00:07:14.134 00:41:21 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:14.134 00:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:14.134 ************************************ 00:07:14.134 END TEST default_locks 00:07:14.134 ************************************ 00:07:14.134 00:41:21 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:07:14.134 00:41:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:14.134 00:41:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.134 00:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:14.393 ************************************ 00:07:14.393 START TEST default_locks_via_rpc 00:07:14.393 ************************************ 00:07:14.393 00:41:21 -- common/autotest_common.sh@1111 -- # default_locks_via_rpc 00:07:14.393 00:41:21 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=145703 00:07:14.393 00:41:21 -- event/cpu_locks.sh@63 -- # waitforlisten 145703 00:07:14.393 00:41:21 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:14.393 00:41:21 -- common/autotest_common.sh@817 -- # '[' -z 145703 ']' 00:07:14.393 00:41:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:14.393 00:41:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:14.393 00:41:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:14.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:14.393 00:41:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:14.393 00:41:21 -- common/autotest_common.sh@10 -- # set +x 00:07:14.393 [2024-04-26 00:41:21.452015] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:14.393 [2024-04-26 00:41:21.452061] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid145703 ] 00:07:14.393 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.393 [2024-04-26 00:41:21.504759] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.393 [2024-04-26 00:41:21.573932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.329 00:41:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:15.329 00:41:22 -- common/autotest_common.sh@850 -- # return 0 00:07:15.329 00:41:22 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:07:15.329 00:41:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.329 00:41:22 -- common/autotest_common.sh@10 -- # set +x 00:07:15.329 00:41:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.329 00:41:22 -- event/cpu_locks.sh@67 -- # no_locks 00:07:15.329 00:41:22 -- event/cpu_locks.sh@26 -- # lock_files=() 00:07:15.329 00:41:22 -- event/cpu_locks.sh@26 -- # local lock_files 00:07:15.329 00:41:22 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:07:15.329 00:41:22 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:07:15.329 00:41:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:15.329 00:41:22 -- common/autotest_common.sh@10 -- # set +x 00:07:15.329 00:41:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:15.329 00:41:22 -- event/cpu_locks.sh@71 -- # locks_exist 145703 00:07:15.329 00:41:22 -- event/cpu_locks.sh@22 -- # lslocks -p 145703 00:07:15.329 00:41:22 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:15.329 00:41:22 -- event/cpu_locks.sh@73 -- # killprocess 145703 00:07:15.329 00:41:22 -- common/autotest_common.sh@936 -- # '[' -z 145703 ']' 00:07:15.329 00:41:22 -- common/autotest_common.sh@940 -- # kill -0 145703 00:07:15.329 00:41:22 -- common/autotest_common.sh@941 -- # uname 00:07:15.329 00:41:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:15.329 00:41:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 145703 00:07:15.588 00:41:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:15.588 00:41:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:15.588 00:41:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 145703' 00:07:15.588 killing process with pid 145703 00:07:15.588 00:41:22 -- common/autotest_common.sh@955 -- # kill 145703 00:07:15.588 00:41:22 -- common/autotest_common.sh@960 -- # wait 145703 00:07:15.847 00:07:15.847 real 0m1.462s 00:07:15.847 user 0m1.518s 00:07:15.847 sys 0m0.451s 00:07:15.847 00:41:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:15.847 00:41:22 -- common/autotest_common.sh@10 -- # set +x 00:07:15.847 ************************************ 00:07:15.847 END TEST default_locks_via_rpc 00:07:15.847 ************************************ 00:07:15.847 00:41:22 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:07:15.847 00:41:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:15.847 00:41:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:15.847 00:41:22 -- common/autotest_common.sh@10 -- # set +x 00:07:15.847 ************************************ 00:07:15.847 START TEST non_locking_app_on_locked_coremask 00:07:15.847 ************************************ 00:07:15.847 00:41:23 -- common/autotest_common.sh@1111 -- # non_locking_app_on_locked_coremask 00:07:15.847 00:41:23 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=146161 00:07:15.847 00:41:23 -- event/cpu_locks.sh@81 -- # waitforlisten 146161 /var/tmp/spdk.sock 00:07:15.847 00:41:23 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:15.847 00:41:23 -- common/autotest_common.sh@817 -- # '[' -z 146161 ']' 00:07:15.847 00:41:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.847 00:41:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:15.847 00:41:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.847 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.847 00:41:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:15.847 00:41:23 -- common/autotest_common.sh@10 -- # set +x 00:07:16.106 [2024-04-26 00:41:23.070661] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:16.106 [2024-04-26 00:41:23.070699] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid146161 ] 00:07:16.106 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.106 [2024-04-26 00:41:23.119090] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.106 [2024-04-26 00:41:23.183862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.674 00:41:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:16.674 00:41:23 -- common/autotest_common.sh@850 -- # return 0 00:07:16.674 00:41:23 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:07:16.674 00:41:23 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=146229 00:07:16.674 00:41:23 -- event/cpu_locks.sh@85 -- # waitforlisten 146229 /var/tmp/spdk2.sock 00:07:16.674 00:41:23 -- common/autotest_common.sh@817 -- # '[' -z 146229 ']' 00:07:16.674 00:41:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:16.674 00:41:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:16.674 00:41:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:16.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:16.674 00:41:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:16.674 00:41:23 -- common/autotest_common.sh@10 -- # set +x 00:07:16.933 [2024-04-26 00:41:23.869602] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:16.933 [2024-04-26 00:41:23.869641] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid146229 ] 00:07:16.933 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.933 [2024-04-26 00:41:23.938027] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:16.933 [2024-04-26 00:41:23.938052] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.933 [2024-04-26 00:41:24.073096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.501 00:41:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:17.501 00:41:24 -- common/autotest_common.sh@850 -- # return 0 00:07:17.501 00:41:24 -- event/cpu_locks.sh@87 -- # locks_exist 146161 00:07:17.501 00:41:24 -- event/cpu_locks.sh@22 -- # lslocks -p 146161 00:07:17.501 00:41:24 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:18.438 lslocks: write error 00:07:18.438 00:41:25 -- event/cpu_locks.sh@89 -- # killprocess 146161 00:07:18.438 00:41:25 -- common/autotest_common.sh@936 -- # '[' -z 146161 ']' 00:07:18.438 00:41:25 -- common/autotest_common.sh@940 -- # kill -0 146161 00:07:18.438 00:41:25 -- common/autotest_common.sh@941 -- # uname 00:07:18.438 00:41:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:18.438 00:41:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 146161 00:07:18.438 00:41:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:18.438 00:41:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:18.438 00:41:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 146161' 00:07:18.438 killing process with pid 146161 00:07:18.438 00:41:25 -- common/autotest_common.sh@955 -- # kill 146161 00:07:18.438 00:41:25 -- common/autotest_common.sh@960 -- # wait 146161 00:07:19.376 00:41:26 -- event/cpu_locks.sh@90 -- # killprocess 146229 00:07:19.377 00:41:26 -- common/autotest_common.sh@936 -- # '[' -z 146229 ']' 00:07:19.377 00:41:26 -- common/autotest_common.sh@940 -- # kill -0 146229 00:07:19.377 00:41:26 -- common/autotest_common.sh@941 -- # uname 00:07:19.377 00:41:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:19.377 00:41:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 146229 00:07:19.377 00:41:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:19.377 00:41:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:19.377 00:41:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 146229' 00:07:19.377 killing process with pid 146229 00:07:19.377 00:41:26 -- common/autotest_common.sh@955 -- # kill 146229 00:07:19.377 00:41:26 -- common/autotest_common.sh@960 -- # wait 146229 00:07:19.636 00:07:19.636 real 0m3.550s 00:07:19.636 user 0m3.736s 00:07:19.636 sys 0m1.037s 00:07:19.636 00:41:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:19.636 00:41:26 -- common/autotest_common.sh@10 -- # set +x 00:07:19.636 ************************************ 00:07:19.636 END TEST non_locking_app_on_locked_coremask 00:07:19.636 ************************************ 00:07:19.636 00:41:26 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:07:19.636 00:41:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:19.636 00:41:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.636 00:41:26 -- common/autotest_common.sh@10 -- # set +x 00:07:19.636 ************************************ 00:07:19.636 START TEST locking_app_on_unlocked_coremask 00:07:19.636 ************************************ 00:07:19.636 00:41:26 -- common/autotest_common.sh@1111 -- # locking_app_on_unlocked_coremask 00:07:19.636 00:41:26 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=146800 00:07:19.636 00:41:26 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:07:19.636 00:41:26 -- event/cpu_locks.sh@99 -- # waitforlisten 146800 /var/tmp/spdk.sock 00:07:19.636 00:41:26 -- common/autotest_common.sh@817 -- # '[' -z 146800 ']' 00:07:19.636 00:41:26 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:19.636 00:41:26 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:19.636 00:41:26 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:19.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:19.636 00:41:26 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:19.636 00:41:26 -- common/autotest_common.sh@10 -- # set +x 00:07:19.636 [2024-04-26 00:41:26.762039] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:19.636 [2024-04-26 00:41:26.762073] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid146800 ] 00:07:19.636 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.636 [2024-04-26 00:41:26.811082] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:19.636 [2024-04-26 00:41:26.811103] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.895 [2024-04-26 00:41:26.883185] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.464 00:41:27 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:20.464 00:41:27 -- common/autotest_common.sh@850 -- # return 0 00:07:20.464 00:41:27 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=147055 00:07:20.464 00:41:27 -- event/cpu_locks.sh@103 -- # waitforlisten 147055 /var/tmp/spdk2.sock 00:07:20.464 00:41:27 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:20.464 00:41:27 -- common/autotest_common.sh@817 -- # '[' -z 147055 ']' 00:07:20.464 00:41:27 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:20.464 00:41:27 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:20.464 00:41:27 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:20.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:20.464 00:41:27 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:20.464 00:41:27 -- common/autotest_common.sh@10 -- # set +x 00:07:20.464 [2024-04-26 00:41:27.581531] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:20.464 [2024-04-26 00:41:27.581575] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid147055 ] 00:07:20.464 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.464 [2024-04-26 00:41:27.649321] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.724 [2024-04-26 00:41:27.778664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.292 00:41:28 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:21.292 00:41:28 -- common/autotest_common.sh@850 -- # return 0 00:07:21.292 00:41:28 -- event/cpu_locks.sh@105 -- # locks_exist 147055 00:07:21.292 00:41:28 -- event/cpu_locks.sh@22 -- # lslocks -p 147055 00:07:21.292 00:41:28 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:21.551 lslocks: write error 00:07:21.551 00:41:28 -- event/cpu_locks.sh@107 -- # killprocess 146800 00:07:21.551 00:41:28 -- common/autotest_common.sh@936 -- # '[' -z 146800 ']' 00:07:21.551 00:41:28 -- common/autotest_common.sh@940 -- # kill -0 146800 00:07:21.551 00:41:28 -- common/autotest_common.sh@941 -- # uname 00:07:21.551 00:41:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:21.551 00:41:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 146800 00:07:21.551 00:41:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:21.551 00:41:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:21.551 00:41:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 146800' 00:07:21.551 killing process with pid 146800 00:07:21.551 00:41:28 -- common/autotest_common.sh@955 -- # kill 146800 00:07:21.551 00:41:28 -- common/autotest_common.sh@960 -- # wait 146800 00:07:22.119 00:41:29 -- event/cpu_locks.sh@108 -- # killprocess 147055 00:07:22.119 00:41:29 -- common/autotest_common.sh@936 -- # '[' -z 147055 ']' 00:07:22.119 00:41:29 -- common/autotest_common.sh@940 -- # kill -0 147055 00:07:22.119 00:41:29 -- common/autotest_common.sh@941 -- # uname 00:07:22.119 00:41:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:22.119 00:41:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 147055 00:07:22.378 00:41:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:22.378 00:41:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:22.378 00:41:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 147055' 00:07:22.378 killing process with pid 147055 00:07:22.378 00:41:29 -- common/autotest_common.sh@955 -- # kill 147055 00:07:22.378 00:41:29 -- common/autotest_common.sh@960 -- # wait 147055 00:07:22.638 00:07:22.638 real 0m2.944s 00:07:22.638 user 0m3.116s 00:07:22.638 sys 0m0.783s 00:07:22.638 00:41:29 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:22.638 00:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:22.638 ************************************ 00:07:22.638 END TEST locking_app_on_unlocked_coremask 00:07:22.638 ************************************ 00:07:22.638 00:41:29 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:07:22.638 00:41:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:22.638 00:41:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.638 00:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:22.897 ************************************ 00:07:22.897 START TEST locking_app_on_locked_coremask 00:07:22.897 ************************************ 00:07:22.897 00:41:29 -- common/autotest_common.sh@1111 -- # locking_app_on_locked_coremask 00:07:22.897 00:41:29 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=147382 00:07:22.897 00:41:29 -- event/cpu_locks.sh@116 -- # waitforlisten 147382 /var/tmp/spdk.sock 00:07:22.897 00:41:29 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:07:22.897 00:41:29 -- common/autotest_common.sh@817 -- # '[' -z 147382 ']' 00:07:22.897 00:41:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:22.897 00:41:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:22.897 00:41:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:22.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:22.897 00:41:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:22.897 00:41:29 -- common/autotest_common.sh@10 -- # set +x 00:07:22.897 [2024-04-26 00:41:29.884833] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:22.897 [2024-04-26 00:41:29.884876] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid147382 ] 00:07:22.897 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.897 [2024-04-26 00:41:29.936765] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.897 [2024-04-26 00:41:30.008543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.466 00:41:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:23.466 00:41:30 -- common/autotest_common.sh@850 -- # return 0 00:07:23.466 00:41:30 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:07:23.466 00:41:30 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=147632 00:07:23.466 00:41:30 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 147632 /var/tmp/spdk2.sock 00:07:23.466 00:41:30 -- common/autotest_common.sh@638 -- # local es=0 00:07:23.466 00:41:30 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 147632 /var/tmp/spdk2.sock 00:07:23.466 00:41:30 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:23.466 00:41:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:23.466 00:41:30 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:23.725 00:41:30 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:23.725 00:41:30 -- common/autotest_common.sh@641 -- # waitforlisten 147632 /var/tmp/spdk2.sock 00:07:23.725 00:41:30 -- common/autotest_common.sh@817 -- # '[' -z 147632 ']' 00:07:23.725 00:41:30 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:23.725 00:41:30 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:23.725 00:41:30 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:23.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:23.725 00:41:30 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:23.725 00:41:30 -- common/autotest_common.sh@10 -- # set +x 00:07:23.725 [2024-04-26 00:41:30.688000] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:23.725 [2024-04-26 00:41:30.688045] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid147632 ] 00:07:23.725 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.725 [2024-04-26 00:41:30.756063] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 147382 has claimed it. 00:07:23.725 [2024-04-26 00:41:30.756097] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:24.293 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (147632) - No such process 00:07:24.293 ERROR: process (pid: 147632) is no longer running 00:07:24.293 00:41:31 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:24.293 00:41:31 -- common/autotest_common.sh@850 -- # return 1 00:07:24.293 00:41:31 -- common/autotest_common.sh@641 -- # es=1 00:07:24.293 00:41:31 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:24.293 00:41:31 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:24.293 00:41:31 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:24.293 00:41:31 -- event/cpu_locks.sh@122 -- # locks_exist 147382 00:07:24.293 00:41:31 -- event/cpu_locks.sh@22 -- # lslocks -p 147382 00:07:24.293 00:41:31 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:07:24.861 lslocks: write error 00:07:24.861 00:41:31 -- event/cpu_locks.sh@124 -- # killprocess 147382 00:07:24.861 00:41:31 -- common/autotest_common.sh@936 -- # '[' -z 147382 ']' 00:07:24.861 00:41:31 -- common/autotest_common.sh@940 -- # kill -0 147382 00:07:24.861 00:41:31 -- common/autotest_common.sh@941 -- # uname 00:07:24.861 00:41:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:24.861 00:41:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 147382 00:07:24.861 00:41:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:24.861 00:41:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:24.861 00:41:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 147382' 00:07:24.861 killing process with pid 147382 00:07:24.861 00:41:31 -- common/autotest_common.sh@955 -- # kill 147382 00:07:24.861 00:41:31 -- common/autotest_common.sh@960 -- # wait 147382 00:07:25.121 00:07:25.121 real 0m2.372s 00:07:25.121 user 0m2.583s 00:07:25.121 sys 0m0.613s 00:07:25.121 00:41:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:25.121 00:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:25.121 ************************************ 00:07:25.121 END TEST locking_app_on_locked_coremask 00:07:25.121 ************************************ 00:07:25.121 00:41:32 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:07:25.121 00:41:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:25.121 00:41:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.121 00:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:25.381 ************************************ 00:07:25.381 START TEST locking_overlapped_coremask 00:07:25.381 ************************************ 00:07:25.381 00:41:32 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask 00:07:25.381 00:41:32 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=147932 00:07:25.381 00:41:32 -- event/cpu_locks.sh@133 -- # waitforlisten 147932 /var/tmp/spdk.sock 00:07:25.381 00:41:32 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:07:25.381 00:41:32 -- common/autotest_common.sh@817 -- # '[' -z 147932 ']' 00:07:25.381 00:41:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:25.381 00:41:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:25.381 00:41:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:25.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:25.381 00:41:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:25.381 00:41:32 -- common/autotest_common.sh@10 -- # set +x 00:07:25.381 [2024-04-26 00:41:32.426074] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:25.381 [2024-04-26 00:41:32.426117] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid147932 ] 00:07:25.381 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.381 [2024-04-26 00:41:32.478095] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:25.381 [2024-04-26 00:41:32.544600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:25.381 [2024-04-26 00:41:32.544690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.381 [2024-04-26 00:41:32.544691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:26.317 00:41:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:26.317 00:41:33 -- common/autotest_common.sh@850 -- # return 0 00:07:26.317 00:41:33 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=148195 00:07:26.317 00:41:33 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 148195 /var/tmp/spdk2.sock 00:07:26.317 00:41:33 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:07:26.317 00:41:33 -- common/autotest_common.sh@638 -- # local es=0 00:07:26.317 00:41:33 -- common/autotest_common.sh@640 -- # valid_exec_arg waitforlisten 148195 /var/tmp/spdk2.sock 00:07:26.317 00:41:33 -- common/autotest_common.sh@626 -- # local arg=waitforlisten 00:07:26.317 00:41:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:26.317 00:41:33 -- common/autotest_common.sh@630 -- # type -t waitforlisten 00:07:26.317 00:41:33 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:26.317 00:41:33 -- common/autotest_common.sh@641 -- # waitforlisten 148195 /var/tmp/spdk2.sock 00:07:26.317 00:41:33 -- common/autotest_common.sh@817 -- # '[' -z 148195 ']' 00:07:26.317 00:41:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:26.317 00:41:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:26.317 00:41:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:26.317 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:26.317 00:41:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:26.317 00:41:33 -- common/autotest_common.sh@10 -- # set +x 00:07:26.317 [2024-04-26 00:41:33.234771] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:26.317 [2024-04-26 00:41:33.234815] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid148195 ] 00:07:26.317 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.317 [2024-04-26 00:41:33.307504] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 147932 has claimed it. 00:07:26.317 [2024-04-26 00:41:33.307537] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:07:26.885 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 832: kill: (148195) - No such process 00:07:26.885 ERROR: process (pid: 148195) is no longer running 00:07:26.885 00:41:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:26.885 00:41:33 -- common/autotest_common.sh@850 -- # return 1 00:07:26.885 00:41:33 -- common/autotest_common.sh@641 -- # es=1 00:07:26.885 00:41:33 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:26.885 00:41:33 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:26.885 00:41:33 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:26.885 00:41:33 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:07:26.885 00:41:33 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:26.885 00:41:33 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:26.885 00:41:33 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:26.885 00:41:33 -- event/cpu_locks.sh@141 -- # killprocess 147932 00:07:26.885 00:41:33 -- common/autotest_common.sh@936 -- # '[' -z 147932 ']' 00:07:26.885 00:41:33 -- common/autotest_common.sh@940 -- # kill -0 147932 00:07:26.885 00:41:33 -- common/autotest_common.sh@941 -- # uname 00:07:26.885 00:41:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:26.885 00:41:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 147932 00:07:26.885 00:41:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:26.885 00:41:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:26.885 00:41:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 147932' 00:07:26.885 killing process with pid 147932 00:07:26.885 00:41:33 -- common/autotest_common.sh@955 -- # kill 147932 00:07:26.885 00:41:33 -- common/autotest_common.sh@960 -- # wait 147932 00:07:27.144 00:07:27.144 real 0m1.844s 00:07:27.144 user 0m5.152s 00:07:27.144 sys 0m0.393s 00:07:27.144 00:41:34 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:27.144 00:41:34 -- common/autotest_common.sh@10 -- # set +x 00:07:27.144 ************************************ 00:07:27.144 END TEST locking_overlapped_coremask 00:07:27.144 ************************************ 00:07:27.144 00:41:34 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:07:27.144 00:41:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.144 00:41:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.144 00:41:34 -- common/autotest_common.sh@10 -- # set +x 00:07:27.403 ************************************ 00:07:27.403 START TEST locking_overlapped_coremask_via_rpc 00:07:27.403 ************************************ 00:07:27.403 00:41:34 -- common/autotest_common.sh@1111 -- # locking_overlapped_coremask_via_rpc 00:07:27.403 00:41:34 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=148386 00:07:27.403 00:41:34 -- event/cpu_locks.sh@149 -- # waitforlisten 148386 /var/tmp/spdk.sock 00:07:27.403 00:41:34 -- common/autotest_common.sh@817 -- # '[' -z 148386 ']' 00:07:27.403 00:41:34 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.403 00:41:34 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:27.403 00:41:34 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.403 00:41:34 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:27.403 00:41:34 -- common/autotest_common.sh@10 -- # set +x 00:07:27.403 00:41:34 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:07:27.403 [2024-04-26 00:41:34.409872] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:27.403 [2024-04-26 00:41:34.409908] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid148386 ] 00:07:27.403 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.403 [2024-04-26 00:41:34.459117] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:27.403 [2024-04-26 00:41:34.459138] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:27.403 [2024-04-26 00:41:34.530944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:27.403 [2024-04-26 00:41:34.530960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:27.403 [2024-04-26 00:41:34.530961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.340 00:41:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:28.340 00:41:35 -- common/autotest_common.sh@850 -- # return 0 00:07:28.340 00:41:35 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=148507 00:07:28.340 00:41:35 -- event/cpu_locks.sh@153 -- # waitforlisten 148507 /var/tmp/spdk2.sock 00:07:28.340 00:41:35 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:07:28.340 00:41:35 -- common/autotest_common.sh@817 -- # '[' -z 148507 ']' 00:07:28.340 00:41:35 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:28.340 00:41:35 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:28.340 00:41:35 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:28.340 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:28.340 00:41:35 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:28.340 00:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:28.340 [2024-04-26 00:41:35.228692] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:28.340 [2024-04-26 00:41:35.228736] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid148507 ] 00:07:28.340 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.341 [2024-04-26 00:41:35.301502] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:07:28.341 [2024-04-26 00:41:35.301524] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:28.341 [2024-04-26 00:41:35.432726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:28.341 [2024-04-26 00:41:35.436288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:28.341 [2024-04-26 00:41:35.436289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:07:28.909 00:41:35 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:28.909 00:41:35 -- common/autotest_common.sh@850 -- # return 0 00:07:28.909 00:41:35 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:07:28.909 00:41:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.909 00:41:35 -- common/autotest_common.sh@10 -- # set +x 00:07:28.909 00:41:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:28.909 00:41:36 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:28.909 00:41:36 -- common/autotest_common.sh@638 -- # local es=0 00:07:28.909 00:41:36 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:28.909 00:41:36 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:07:28.909 00:41:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:28.909 00:41:36 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:07:28.909 00:41:36 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:28.909 00:41:36 -- common/autotest_common.sh@641 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:07:28.909 00:41:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:28.909 00:41:36 -- common/autotest_common.sh@10 -- # set +x 00:07:28.909 [2024-04-26 00:41:36.018301] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 148386 has claimed it. 00:07:28.909 request: 00:07:28.909 { 00:07:28.909 "method": "framework_enable_cpumask_locks", 00:07:28.909 "req_id": 1 00:07:28.909 } 00:07:28.909 Got JSON-RPC error response 00:07:28.909 response: 00:07:28.909 { 00:07:28.909 "code": -32603, 00:07:28.909 "message": "Failed to claim CPU core: 2" 00:07:28.909 } 00:07:28.909 00:41:36 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:07:28.909 00:41:36 -- common/autotest_common.sh@641 -- # es=1 00:07:28.909 00:41:36 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:28.909 00:41:36 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:28.909 00:41:36 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:28.909 00:41:36 -- event/cpu_locks.sh@158 -- # waitforlisten 148386 /var/tmp/spdk.sock 00:07:28.909 00:41:36 -- common/autotest_common.sh@817 -- # '[' -z 148386 ']' 00:07:28.909 00:41:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.909 00:41:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:28.909 00:41:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.909 00:41:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:28.909 00:41:36 -- common/autotest_common.sh@10 -- # set +x 00:07:29.168 00:41:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:29.168 00:41:36 -- common/autotest_common.sh@850 -- # return 0 00:07:29.168 00:41:36 -- event/cpu_locks.sh@159 -- # waitforlisten 148507 /var/tmp/spdk2.sock 00:07:29.168 00:41:36 -- common/autotest_common.sh@817 -- # '[' -z 148507 ']' 00:07:29.168 00:41:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk2.sock 00:07:29.168 00:41:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:29.168 00:41:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:07:29.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:07:29.168 00:41:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:29.168 00:41:36 -- common/autotest_common.sh@10 -- # set +x 00:07:29.428 00:41:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:29.428 00:41:36 -- common/autotest_common.sh@850 -- # return 0 00:07:29.428 00:41:36 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:07:29.428 00:41:36 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:07:29.428 00:41:36 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:07:29.428 00:41:36 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:07:29.428 00:07:29.428 real 0m2.009s 00:07:29.428 user 0m0.781s 00:07:29.428 sys 0m0.158s 00:07:29.428 00:41:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:29.428 00:41:36 -- common/autotest_common.sh@10 -- # set +x 00:07:29.428 ************************************ 00:07:29.428 END TEST locking_overlapped_coremask_via_rpc 00:07:29.428 ************************************ 00:07:29.428 00:41:36 -- event/cpu_locks.sh@174 -- # cleanup 00:07:29.428 00:41:36 -- event/cpu_locks.sh@15 -- # [[ -z 148386 ]] 00:07:29.428 00:41:36 -- event/cpu_locks.sh@15 -- # killprocess 148386 00:07:29.428 00:41:36 -- common/autotest_common.sh@936 -- # '[' -z 148386 ']' 00:07:29.428 00:41:36 -- common/autotest_common.sh@940 -- # kill -0 148386 00:07:29.428 00:41:36 -- common/autotest_common.sh@941 -- # uname 00:07:29.428 00:41:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.428 00:41:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 148386 00:07:29.428 00:41:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:29.428 00:41:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:29.428 00:41:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 148386' 00:07:29.428 killing process with pid 148386 00:07:29.428 00:41:36 -- common/autotest_common.sh@955 -- # kill 148386 00:07:29.428 00:41:36 -- common/autotest_common.sh@960 -- # wait 148386 00:07:29.687 00:41:36 -- event/cpu_locks.sh@16 -- # [[ -z 148507 ]] 00:07:29.687 00:41:36 -- event/cpu_locks.sh@16 -- # killprocess 148507 00:07:29.687 00:41:36 -- common/autotest_common.sh@936 -- # '[' -z 148507 ']' 00:07:29.687 00:41:36 -- common/autotest_common.sh@940 -- # kill -0 148507 00:07:29.687 00:41:36 -- common/autotest_common.sh@941 -- # uname 00:07:29.687 00:41:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.687 00:41:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 148507 00:07:29.687 00:41:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:07:29.687 00:41:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:07:29.687 00:41:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 148507' 00:07:29.687 killing process with pid 148507 00:07:29.687 00:41:36 -- common/autotest_common.sh@955 -- # kill 148507 00:07:29.687 00:41:36 -- common/autotest_common.sh@960 -- # wait 148507 00:07:30.256 00:41:37 -- event/cpu_locks.sh@18 -- # rm -f 00:07:30.256 00:41:37 -- event/cpu_locks.sh@1 -- # cleanup 00:07:30.256 00:41:37 -- event/cpu_locks.sh@15 -- # [[ -z 148386 ]] 00:07:30.256 00:41:37 -- event/cpu_locks.sh@15 -- # killprocess 148386 00:07:30.256 00:41:37 -- common/autotest_common.sh@936 -- # '[' -z 148386 ']' 00:07:30.256 00:41:37 -- common/autotest_common.sh@940 -- # kill -0 148386 00:07:30.256 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (148386) - No such process 00:07:30.256 00:41:37 -- common/autotest_common.sh@963 -- # echo 'Process with pid 148386 is not found' 00:07:30.256 Process with pid 148386 is not found 00:07:30.256 00:41:37 -- event/cpu_locks.sh@16 -- # [[ -z 148507 ]] 00:07:30.256 00:41:37 -- event/cpu_locks.sh@16 -- # killprocess 148507 00:07:30.256 00:41:37 -- common/autotest_common.sh@936 -- # '[' -z 148507 ']' 00:07:30.256 00:41:37 -- common/autotest_common.sh@940 -- # kill -0 148507 00:07:30.256 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (148507) - No such process 00:07:30.256 00:41:37 -- common/autotest_common.sh@963 -- # echo 'Process with pid 148507 is not found' 00:07:30.256 Process with pid 148507 is not found 00:07:30.256 00:41:37 -- event/cpu_locks.sh@18 -- # rm -f 00:07:30.256 00:07:30.256 real 0m17.463s 00:07:30.256 user 0m28.767s 00:07:30.256 sys 0m4.966s 00:07:30.256 00:41:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:30.256 00:41:37 -- common/autotest_common.sh@10 -- # set +x 00:07:30.256 ************************************ 00:07:30.256 END TEST cpu_locks 00:07:30.256 ************************************ 00:07:30.256 00:07:30.256 real 0m43.307s 00:07:30.256 user 1m18.090s 00:07:30.256 sys 0m8.424s 00:07:30.257 00:41:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:30.257 00:41:37 -- common/autotest_common.sh@10 -- # set +x 00:07:30.257 ************************************ 00:07:30.257 END TEST event 00:07:30.257 ************************************ 00:07:30.257 00:41:37 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:07:30.257 00:41:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:30.257 00:41:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.257 00:41:37 -- common/autotest_common.sh@10 -- # set +x 00:07:30.257 ************************************ 00:07:30.257 START TEST thread 00:07:30.257 ************************************ 00:07:30.257 00:41:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:07:30.257 * Looking for test storage... 00:07:30.257 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:07:30.257 00:41:37 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:30.257 00:41:37 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:30.257 00:41:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.257 00:41:37 -- common/autotest_common.sh@10 -- # set +x 00:07:30.516 ************************************ 00:07:30.516 START TEST thread_poller_perf 00:07:30.516 ************************************ 00:07:30.516 00:41:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:07:30.516 [2024-04-26 00:41:37.569946] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:30.516 [2024-04-26 00:41:37.570009] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid149138 ] 00:07:30.516 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.516 [2024-04-26 00:41:37.625957] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.516 [2024-04-26 00:41:37.693056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:30.516 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:07:31.895 ====================================== 00:07:31.895 busy:2705844948 (cyc) 00:07:31.895 total_run_count: 452000 00:07:31.895 tsc_hz: 2700000000 (cyc) 00:07:31.895 ====================================== 00:07:31.895 poller_cost: 5986 (cyc), 2217 (nsec) 00:07:31.895 00:07:31.895 real 0m1.234s 00:07:31.895 user 0m1.157s 00:07:31.895 sys 0m0.073s 00:07:31.895 00:41:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:31.895 00:41:38 -- common/autotest_common.sh@10 -- # set +x 00:07:31.895 ************************************ 00:07:31.895 END TEST thread_poller_perf 00:07:31.895 ************************************ 00:07:31.895 00:41:38 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:31.895 00:41:38 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:31.895 00:41:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.895 00:41:38 -- common/autotest_common.sh@10 -- # set +x 00:07:31.895 ************************************ 00:07:31.895 START TEST thread_poller_perf 00:07:31.895 ************************************ 00:07:31.895 00:41:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:07:31.895 [2024-04-26 00:41:38.932411] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:31.895 [2024-04-26 00:41:38.932475] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid149429 ] 00:07:31.895 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.895 [2024-04-26 00:41:38.988425] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.895 [2024-04-26 00:41:39.056335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.895 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:07:33.275 ====================================== 00:07:33.275 busy:2701757192 (cyc) 00:07:33.275 total_run_count: 5921000 00:07:33.275 tsc_hz: 2700000000 (cyc) 00:07:33.275 ====================================== 00:07:33.275 poller_cost: 456 (cyc), 168 (nsec) 00:07:33.275 00:07:33.275 real 0m1.233s 00:07:33.275 user 0m1.160s 00:07:33.275 sys 0m0.069s 00:07:33.275 00:41:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:33.275 00:41:40 -- common/autotest_common.sh@10 -- # set +x 00:07:33.275 ************************************ 00:07:33.275 END TEST thread_poller_perf 00:07:33.275 ************************************ 00:07:33.275 00:41:40 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:07:33.275 00:07:33.275 real 0m2.851s 00:07:33.275 user 0m2.458s 00:07:33.275 sys 0m0.371s 00:07:33.275 00:41:40 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:33.275 00:41:40 -- common/autotest_common.sh@10 -- # set +x 00:07:33.275 ************************************ 00:07:33.275 END TEST thread 00:07:33.275 ************************************ 00:07:33.275 00:41:40 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:07:33.275 00:41:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:33.275 00:41:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.275 00:41:40 -- common/autotest_common.sh@10 -- # set +x 00:07:33.275 ************************************ 00:07:33.275 START TEST accel 00:07:33.275 ************************************ 00:07:33.275 00:41:40 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:07:33.275 * Looking for test storage... 00:07:33.275 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:07:33.275 00:41:40 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:07:33.275 00:41:40 -- accel/accel.sh@82 -- # get_expected_opcs 00:07:33.275 00:41:40 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:33.275 00:41:40 -- accel/accel.sh@62 -- # spdk_tgt_pid=149755 00:07:33.275 00:41:40 -- accel/accel.sh@63 -- # waitforlisten 149755 00:07:33.275 00:41:40 -- common/autotest_common.sh@817 -- # '[' -z 149755 ']' 00:07:33.275 00:41:40 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.275 00:41:40 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:07:33.275 00:41:40 -- common/autotest_common.sh@822 -- # local max_retries=100 00:07:33.275 00:41:40 -- accel/accel.sh@61 -- # build_accel_config 00:07:33.275 00:41:40 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.275 00:41:40 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:33.275 00:41:40 -- common/autotest_common.sh@826 -- # xtrace_disable 00:07:33.275 00:41:40 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:33.275 00:41:40 -- common/autotest_common.sh@10 -- # set +x 00:07:33.275 00:41:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.275 00:41:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.275 00:41:40 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:33.275 00:41:40 -- accel/accel.sh@40 -- # local IFS=, 00:07:33.275 00:41:40 -- accel/accel.sh@41 -- # jq -r . 00:07:33.535 [2024-04-26 00:41:40.495159] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:33.535 [2024-04-26 00:41:40.495202] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid149755 ] 00:07:33.535 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.535 [2024-04-26 00:41:40.544525] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.535 [2024-04-26 00:41:40.616546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.104 00:41:41 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:07:34.104 00:41:41 -- common/autotest_common.sh@850 -- # return 0 00:07:34.104 00:41:41 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:07:34.104 00:41:41 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:07:34.104 00:41:41 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:07:34.104 00:41:41 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:07:34.104 00:41:41 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:07:34.104 00:41:41 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:07:34.104 00:41:41 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:07:34.104 00:41:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:07:34.104 00:41:41 -- common/autotest_common.sh@10 -- # set +x 00:07:34.104 00:41:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # IFS== 00:07:34.363 00:41:41 -- accel/accel.sh@72 -- # read -r opc module 00:07:34.363 00:41:41 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:07:34.363 00:41:41 -- accel/accel.sh@75 -- # killprocess 149755 00:07:34.363 00:41:41 -- common/autotest_common.sh@936 -- # '[' -z 149755 ']' 00:07:34.363 00:41:41 -- common/autotest_common.sh@940 -- # kill -0 149755 00:07:34.363 00:41:41 -- common/autotest_common.sh@941 -- # uname 00:07:34.363 00:41:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:34.363 00:41:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 149755 00:07:34.363 00:41:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:34.363 00:41:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:34.363 00:41:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 149755' 00:07:34.363 killing process with pid 149755 00:07:34.363 00:41:41 -- common/autotest_common.sh@955 -- # kill 149755 00:07:34.363 00:41:41 -- common/autotest_common.sh@960 -- # wait 149755 00:07:34.622 00:41:41 -- accel/accel.sh@76 -- # trap - ERR 00:07:34.622 00:41:41 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:07:34.622 00:41:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:34.622 00:41:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.622 00:41:41 -- common/autotest_common.sh@10 -- # set +x 00:07:34.881 00:41:41 -- common/autotest_common.sh@1111 -- # accel_perf -h 00:07:34.881 00:41:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:07:34.881 00:41:41 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.881 00:41:41 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:34.881 00:41:41 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:41 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:34.881 00:41:41 -- accel/accel.sh@40 -- # local IFS=, 00:07:34.881 00:41:41 -- accel/accel.sh@41 -- # jq -r . 00:07:34.881 00:41:41 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:34.881 00:41:41 -- common/autotest_common.sh@10 -- # set +x 00:07:34.881 00:41:41 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:07:34.881 00:41:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:34.881 00:41:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:34.881 00:41:41 -- common/autotest_common.sh@10 -- # set +x 00:07:34.881 ************************************ 00:07:34.881 START TEST accel_missing_filename 00:07:34.881 ************************************ 00:07:34.881 00:41:42 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress 00:07:34.881 00:41:42 -- common/autotest_common.sh@638 -- # local es=0 00:07:34.881 00:41:42 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress 00:07:34.881 00:41:42 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:34.881 00:41:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:34.881 00:41:42 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:34.881 00:41:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:34.881 00:41:42 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress 00:07:34.881 00:41:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:07:34.881 00:41:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.881 00:41:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:34.881 00:41:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.881 00:41:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:34.881 00:41:42 -- accel/accel.sh@40 -- # local IFS=, 00:07:34.881 00:41:42 -- accel/accel.sh@41 -- # jq -r . 00:07:34.881 [2024-04-26 00:41:42.056284] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:34.881 [2024-04-26 00:41:42.056344] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid150073 ] 00:07:35.140 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.140 [2024-04-26 00:41:42.112323] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.140 [2024-04-26 00:41:42.184103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.140 [2024-04-26 00:41:42.223979] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:35.140 [2024-04-26 00:41:42.283706] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:35.397 A filename is required. 00:07:35.397 00:41:42 -- common/autotest_common.sh@641 -- # es=234 00:07:35.397 00:41:42 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:35.397 00:41:42 -- common/autotest_common.sh@650 -- # es=106 00:07:35.397 00:41:42 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:35.398 00:41:42 -- common/autotest_common.sh@658 -- # es=1 00:07:35.398 00:41:42 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:35.398 00:07:35.398 real 0m0.343s 00:07:35.398 user 0m0.261s 00:07:35.398 sys 0m0.118s 00:07:35.398 00:41:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:35.398 00:41:42 -- common/autotest_common.sh@10 -- # set +x 00:07:35.398 ************************************ 00:07:35.398 END TEST accel_missing_filename 00:07:35.398 ************************************ 00:07:35.398 00:41:42 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:35.398 00:41:42 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:35.398 00:41:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.398 00:41:42 -- common/autotest_common.sh@10 -- # set +x 00:07:35.398 ************************************ 00:07:35.398 START TEST accel_compress_verify 00:07:35.398 ************************************ 00:07:35.398 00:41:42 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:35.398 00:41:42 -- common/autotest_common.sh@638 -- # local es=0 00:07:35.398 00:41:42 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:35.398 00:41:42 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:35.398 00:41:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:35.398 00:41:42 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:35.398 00:41:42 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:35.398 00:41:42 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:35.398 00:41:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:35.398 00:41:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.398 00:41:42 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:35.398 00:41:42 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:35.398 00:41:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.398 00:41:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.398 00:41:42 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:35.398 00:41:42 -- accel/accel.sh@40 -- # local IFS=, 00:07:35.398 00:41:42 -- accel/accel.sh@41 -- # jq -r . 00:07:35.398 [2024-04-26 00:41:42.562543] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:35.398 [2024-04-26 00:41:42.562607] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid150106 ] 00:07:35.398 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.656 [2024-04-26 00:41:42.616051] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.656 [2024-04-26 00:41:42.681954] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.656 [2024-04-26 00:41:42.722218] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:07:35.656 [2024-04-26 00:41:42.781840] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:07:35.914 00:07:35.914 Compression does not support the verify option, aborting. 00:07:35.914 00:41:42 -- common/autotest_common.sh@641 -- # es=161 00:07:35.914 00:41:42 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:35.914 00:41:42 -- common/autotest_common.sh@650 -- # es=33 00:07:35.914 00:41:42 -- common/autotest_common.sh@651 -- # case "$es" in 00:07:35.914 00:41:42 -- common/autotest_common.sh@658 -- # es=1 00:07:35.914 00:41:42 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:35.914 00:07:35.914 real 0m0.336s 00:07:35.914 user 0m0.259s 00:07:35.914 sys 0m0.117s 00:07:35.914 00:41:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:35.914 00:41:42 -- common/autotest_common.sh@10 -- # set +x 00:07:35.914 ************************************ 00:07:35.914 END TEST accel_compress_verify 00:07:35.914 ************************************ 00:07:35.914 00:41:42 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:07:35.914 00:41:42 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:35.914 00:41:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.914 00:41:42 -- common/autotest_common.sh@10 -- # set +x 00:07:35.914 ************************************ 00:07:35.914 START TEST accel_wrong_workload 00:07:35.914 ************************************ 00:07:35.914 00:41:43 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w foobar 00:07:35.914 00:41:43 -- common/autotest_common.sh@638 -- # local es=0 00:07:35.914 00:41:43 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:07:35.914 00:41:43 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:35.914 00:41:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:35.915 00:41:43 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:35.915 00:41:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:35.915 00:41:43 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w foobar 00:07:35.915 00:41:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:07:35.915 00:41:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.915 00:41:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:35.915 00:41:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:35.915 00:41:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.915 00:41:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.915 00:41:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:35.915 00:41:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:35.915 00:41:43 -- accel/accel.sh@41 -- # jq -r . 00:07:35.915 Unsupported workload type: foobar 00:07:35.915 [2024-04-26 00:41:43.059929] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:07:35.915 accel_perf options: 00:07:35.915 [-h help message] 00:07:35.915 [-q queue depth per core] 00:07:35.915 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:35.915 [-T number of threads per core 00:07:35.915 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:35.915 [-t time in seconds] 00:07:35.915 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:35.915 [ dif_verify, , dif_generate, dif_generate_copy 00:07:35.915 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:35.915 [-l for compress/decompress workloads, name of uncompressed input file 00:07:35.915 [-S for crc32c workload, use this seed value (default 0) 00:07:35.915 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:35.915 [-f for fill workload, use this BYTE value (default 255) 00:07:35.915 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:35.915 [-y verify result if this switch is on] 00:07:35.915 [-a tasks to allocate per core (default: same value as -q)] 00:07:35.915 Can be used to spread operations across a wider range of memory. 00:07:35.915 00:41:43 -- common/autotest_common.sh@641 -- # es=1 00:07:35.915 00:41:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:35.915 00:41:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:35.915 00:41:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:35.915 00:07:35.915 real 0m0.033s 00:07:35.915 user 0m0.022s 00:07:35.915 sys 0m0.011s 00:07:35.915 00:41:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:35.915 00:41:43 -- common/autotest_common.sh@10 -- # set +x 00:07:35.915 ************************************ 00:07:35.915 END TEST accel_wrong_workload 00:07:35.915 ************************************ 00:07:35.915 Error: writing output failed: Broken pipe 00:07:35.915 00:41:43 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:07:35.915 00:41:43 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:07:35.915 00:41:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:35.915 00:41:43 -- common/autotest_common.sh@10 -- # set +x 00:07:36.174 ************************************ 00:07:36.174 START TEST accel_negative_buffers 00:07:36.174 ************************************ 00:07:36.174 00:41:43 -- common/autotest_common.sh@1111 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:07:36.174 00:41:43 -- common/autotest_common.sh@638 -- # local es=0 00:07:36.174 00:41:43 -- common/autotest_common.sh@640 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:07:36.174 00:41:43 -- common/autotest_common.sh@626 -- # local arg=accel_perf 00:07:36.174 00:41:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:36.174 00:41:43 -- common/autotest_common.sh@630 -- # type -t accel_perf 00:07:36.174 00:41:43 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:07:36.174 00:41:43 -- common/autotest_common.sh@641 -- # accel_perf -t 1 -w xor -y -x -1 00:07:36.174 00:41:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:07:36.174 00:41:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.174 00:41:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:36.174 00:41:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:36.174 00:41:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.174 00:41:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.174 00:41:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:36.174 00:41:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:36.174 00:41:43 -- accel/accel.sh@41 -- # jq -r . 00:07:36.174 -x option must be non-negative. 00:07:36.174 [2024-04-26 00:41:43.253193] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:07:36.174 accel_perf options: 00:07:36.174 [-h help message] 00:07:36.174 [-q queue depth per core] 00:07:36.174 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:07:36.174 [-T number of threads per core 00:07:36.174 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:07:36.174 [-t time in seconds] 00:07:36.174 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:07:36.174 [ dif_verify, , dif_generate, dif_generate_copy 00:07:36.174 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:07:36.174 [-l for compress/decompress workloads, name of uncompressed input file 00:07:36.174 [-S for crc32c workload, use this seed value (default 0) 00:07:36.174 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:07:36.174 [-f for fill workload, use this BYTE value (default 255) 00:07:36.174 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:07:36.174 [-y verify result if this switch is on] 00:07:36.174 [-a tasks to allocate per core (default: same value as -q)] 00:07:36.174 Can be used to spread operations across a wider range of memory. 00:07:36.174 00:41:43 -- common/autotest_common.sh@641 -- # es=1 00:07:36.174 00:41:43 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:07:36.174 00:41:43 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:07:36.174 00:41:43 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:07:36.174 00:07:36.174 real 0m0.033s 00:07:36.174 user 0m0.022s 00:07:36.174 sys 0m0.011s 00:07:36.174 00:41:43 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:36.174 00:41:43 -- common/autotest_common.sh@10 -- # set +x 00:07:36.174 ************************************ 00:07:36.174 END TEST accel_negative_buffers 00:07:36.174 ************************************ 00:07:36.174 Error: writing output failed: Broken pipe 00:07:36.174 00:41:43 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:07:36.174 00:41:43 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:36.174 00:41:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.174 00:41:43 -- common/autotest_common.sh@10 -- # set +x 00:07:36.433 ************************************ 00:07:36.433 START TEST accel_crc32c 00:07:36.433 ************************************ 00:07:36.433 00:41:43 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -S 32 -y 00:07:36.433 00:41:43 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.433 00:41:43 -- accel/accel.sh@17 -- # local accel_module 00:07:36.433 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.433 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.433 00:41:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:07:36.433 00:41:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:07:36.433 00:41:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.433 00:41:43 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:36.433 00:41:43 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:36.433 00:41:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.433 00:41:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.433 00:41:43 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:36.433 00:41:43 -- accel/accel.sh@40 -- # local IFS=, 00:07:36.433 00:41:43 -- accel/accel.sh@41 -- # jq -r . 00:07:36.433 [2024-04-26 00:41:43.461650] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:36.433 [2024-04-26 00:41:43.461721] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid150438 ] 00:07:36.433 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.433 [2024-04-26 00:41:43.517397] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.433 [2024-04-26 00:41:43.593416] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=0x1 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=crc32c 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=32 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=software 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@22 -- # accel_module=software 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=32 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=32 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=1 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val=Yes 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:36.692 00:41:43 -- accel/accel.sh@20 -- # val= 00:07:36.692 00:41:43 -- accel/accel.sh@21 -- # case "$var" in 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # IFS=: 00:07:36.692 00:41:43 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@20 -- # val= 00:07:37.628 00:41:44 -- accel/accel.sh@21 -- # case "$var" in 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.628 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.628 00:41:44 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:37.628 00:41:44 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:37.628 00:41:44 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:37.628 00:07:37.628 real 0m1.353s 00:07:37.628 user 0m1.243s 00:07:37.628 sys 0m0.123s 00:07:37.628 00:41:44 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:37.628 00:41:44 -- common/autotest_common.sh@10 -- # set +x 00:07:37.628 ************************************ 00:07:37.628 END TEST accel_crc32c 00:07:37.628 ************************************ 00:07:37.888 00:41:44 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:07:37.888 00:41:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:37.888 00:41:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.888 00:41:44 -- common/autotest_common.sh@10 -- # set +x 00:07:37.888 ************************************ 00:07:37.888 START TEST accel_crc32c_C2 00:07:37.888 ************************************ 00:07:37.888 00:41:44 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w crc32c -y -C 2 00:07:37.888 00:41:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:37.888 00:41:44 -- accel/accel.sh@17 -- # local accel_module 00:07:37.888 00:41:44 -- accel/accel.sh@19 -- # IFS=: 00:07:37.888 00:41:44 -- accel/accel.sh@19 -- # read -r var val 00:07:37.888 00:41:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:37.888 00:41:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:37.888 00:41:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.888 00:41:44 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:37.888 00:41:44 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:37.888 00:41:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.888 00:41:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.888 00:41:44 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:37.888 00:41:44 -- accel/accel.sh@40 -- # local IFS=, 00:07:37.888 00:41:44 -- accel/accel.sh@41 -- # jq -r . 00:07:37.888 [2024-04-26 00:41:44.983330] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:37.888 [2024-04-26 00:41:44.983376] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid150734 ] 00:07:37.888 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.888 [2024-04-26 00:41:45.035037] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.147 [2024-04-26 00:41:45.105321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=0x1 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=crc32c 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=0 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=software 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@22 -- # accel_module=software 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=32 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=32 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=1 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val=Yes 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:38.147 00:41:45 -- accel/accel.sh@20 -- # val= 00:07:38.147 00:41:45 -- accel/accel.sh@21 -- # case "$var" in 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # IFS=: 00:07:38.147 00:41:45 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:39.524 00:41:46 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:07:39.524 00:41:46 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:39.524 00:07:39.524 real 0m1.342s 00:07:39.524 user 0m1.242s 00:07:39.524 sys 0m0.114s 00:07:39.524 00:41:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:39.524 00:41:46 -- common/autotest_common.sh@10 -- # set +x 00:07:39.524 ************************************ 00:07:39.524 END TEST accel_crc32c_C2 00:07:39.524 ************************************ 00:07:39.524 00:41:46 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:39.524 00:41:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:39.524 00:41:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.524 00:41:46 -- common/autotest_common.sh@10 -- # set +x 00:07:39.524 ************************************ 00:07:39.524 START TEST accel_copy 00:07:39.524 ************************************ 00:07:39.524 00:41:46 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy -y 00:07:39.524 00:41:46 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.524 00:41:46 -- accel/accel.sh@17 -- # local accel_module 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:39.524 00:41:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:39.524 00:41:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.524 00:41:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:39.524 00:41:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:39.524 00:41:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.524 00:41:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.524 00:41:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:39.524 00:41:46 -- accel/accel.sh@40 -- # local IFS=, 00:07:39.524 00:41:46 -- accel/accel.sh@41 -- # jq -r . 00:07:39.524 [2024-04-26 00:41:46.489856] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:39.524 [2024-04-26 00:41:46.489921] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151021 ] 00:07:39.524 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.524 [2024-04-26 00:41:46.542236] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.524 [2024-04-26 00:41:46.608359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val=0x1 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.524 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.524 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.524 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=copy 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@23 -- # accel_opc=copy 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=software 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@22 -- # accel_module=software 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=32 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=32 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=1 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val=Yes 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:39.525 00:41:46 -- accel/accel.sh@20 -- # val= 00:07:39.525 00:41:46 -- accel/accel.sh@21 -- # case "$var" in 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # IFS=: 00:07:39.525 00:41:46 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@20 -- # val= 00:07:40.902 00:41:47 -- accel/accel.sh@21 -- # case "$var" in 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:40.902 00:41:47 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:07:40.902 00:41:47 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:40.902 00:07:40.902 real 0m1.337s 00:07:40.902 user 0m1.246s 00:07:40.902 sys 0m0.102s 00:07:40.902 00:41:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:40.902 00:41:47 -- common/autotest_common.sh@10 -- # set +x 00:07:40.902 ************************************ 00:07:40.902 END TEST accel_copy 00:07:40.902 ************************************ 00:07:40.902 00:41:47 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:40.902 00:41:47 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:40.902 00:41:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:40.902 00:41:47 -- common/autotest_common.sh@10 -- # set +x 00:07:40.902 ************************************ 00:07:40.902 START TEST accel_fill 00:07:40.902 ************************************ 00:07:40.902 00:41:47 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:40.902 00:41:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:40.902 00:41:47 -- accel/accel.sh@17 -- # local accel_module 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # IFS=: 00:07:40.902 00:41:47 -- accel/accel.sh@19 -- # read -r var val 00:07:40.902 00:41:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:40.902 00:41:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:40.902 00:41:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.902 00:41:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:40.902 00:41:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:40.902 00:41:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.902 00:41:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.902 00:41:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:40.902 00:41:47 -- accel/accel.sh@40 -- # local IFS=, 00:07:40.902 00:41:47 -- accel/accel.sh@41 -- # jq -r . 00:07:40.902 [2024-04-26 00:41:47.994587] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:40.902 [2024-04-26 00:41:47.994654] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151313 ] 00:07:40.902 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.902 [2024-04-26 00:41:48.048986] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.162 [2024-04-26 00:41:48.121063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=0x1 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=fill 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@23 -- # accel_opc=fill 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=0x80 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=software 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@22 -- # accel_module=software 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=64 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=64 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=1 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val=Yes 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:41.162 00:41:48 -- accel/accel.sh@20 -- # val= 00:07:41.162 00:41:48 -- accel/accel.sh@21 -- # case "$var" in 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # IFS=: 00:07:41.162 00:41:48 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:42.540 00:41:49 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:07:42.540 00:41:49 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:42.540 00:07:42.540 real 0m1.348s 00:07:42.540 user 0m1.239s 00:07:42.540 sys 0m0.122s 00:07:42.540 00:41:49 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:42.540 00:41:49 -- common/autotest_common.sh@10 -- # set +x 00:07:42.540 ************************************ 00:07:42.540 END TEST accel_fill 00:07:42.540 ************************************ 00:07:42.540 00:41:49 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:42.540 00:41:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:42.540 00:41:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.540 00:41:49 -- common/autotest_common.sh@10 -- # set +x 00:07:42.540 ************************************ 00:07:42.540 START TEST accel_copy_crc32c 00:07:42.540 ************************************ 00:07:42.540 00:41:49 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y 00:07:42.540 00:41:49 -- accel/accel.sh@16 -- # local accel_opc 00:07:42.540 00:41:49 -- accel/accel.sh@17 -- # local accel_module 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:42.540 00:41:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:42.540 00:41:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.540 00:41:49 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:42.540 00:41:49 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:42.540 00:41:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.540 00:41:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.540 00:41:49 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:42.540 00:41:49 -- accel/accel.sh@40 -- # local IFS=, 00:07:42.540 00:41:49 -- accel/accel.sh@41 -- # jq -r . 00:07:42.540 [2024-04-26 00:41:49.503213] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:42.540 [2024-04-26 00:41:49.503291] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151600 ] 00:07:42.540 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.540 [2024-04-26 00:41:49.557770] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:42.540 [2024-04-26 00:41:49.628745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val=0x1 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val=0 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.540 00:41:49 -- accel/accel.sh@20 -- # val=software 00:07:42.540 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.540 00:41:49 -- accel/accel.sh@22 -- # accel_module=software 00:07:42.540 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val=32 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val=32 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val=1 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val=Yes 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:42.541 00:41:49 -- accel/accel.sh@20 -- # val= 00:07:42.541 00:41:49 -- accel/accel.sh@21 -- # case "$var" in 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # IFS=: 00:07:42.541 00:41:49 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@20 -- # val= 00:07:43.914 00:41:50 -- accel/accel.sh@21 -- # case "$var" in 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.914 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.914 00:41:50 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:43.914 00:41:50 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:43.914 00:41:50 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:43.914 00:07:43.914 real 0m1.347s 00:07:43.914 user 0m1.246s 00:07:43.914 sys 0m0.115s 00:07:43.914 00:41:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:43.914 00:41:50 -- common/autotest_common.sh@10 -- # set +x 00:07:43.914 ************************************ 00:07:43.914 END TEST accel_copy_crc32c 00:07:43.914 ************************************ 00:07:43.914 00:41:50 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:43.914 00:41:50 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:43.914 00:41:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.914 00:41:50 -- common/autotest_common.sh@10 -- # set +x 00:07:43.914 ************************************ 00:07:43.914 START TEST accel_copy_crc32c_C2 00:07:43.914 ************************************ 00:07:43.914 00:41:50 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:43.915 00:41:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:43.915 00:41:50 -- accel/accel.sh@17 -- # local accel_module 00:07:43.915 00:41:50 -- accel/accel.sh@19 -- # IFS=: 00:07:43.915 00:41:50 -- accel/accel.sh@19 -- # read -r var val 00:07:43.915 00:41:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:43.915 00:41:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:43.915 00:41:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.915 00:41:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:43.915 00:41:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:43.915 00:41:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.915 00:41:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.915 00:41:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:43.915 00:41:50 -- accel/accel.sh@40 -- # local IFS=, 00:07:43.915 00:41:50 -- accel/accel.sh@41 -- # jq -r . 00:07:43.915 [2024-04-26 00:41:51.010825] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:43.915 [2024-04-26 00:41:51.010890] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid151889 ] 00:07:43.915 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.915 [2024-04-26 00:41:51.066221] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.175 [2024-04-26 00:41:51.137900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=0x1 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=copy_crc32c 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=0 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val='8192 bytes' 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=software 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@22 -- # accel_module=software 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=32 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=32 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=1 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val=Yes 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:44.175 00:41:51 -- accel/accel.sh@20 -- # val= 00:07:44.175 00:41:51 -- accel/accel.sh@21 -- # case "$var" in 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # IFS=: 00:07:44.175 00:41:51 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:45.551 00:41:52 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:07:45.551 00:41:52 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:45.551 00:07:45.551 real 0m1.348s 00:07:45.551 user 0m1.247s 00:07:45.551 sys 0m0.114s 00:07:45.551 00:41:52 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:45.551 00:41:52 -- common/autotest_common.sh@10 -- # set +x 00:07:45.551 ************************************ 00:07:45.551 END TEST accel_copy_crc32c_C2 00:07:45.551 ************************************ 00:07:45.551 00:41:52 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:45.551 00:41:52 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:45.551 00:41:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.551 00:41:52 -- common/autotest_common.sh@10 -- # set +x 00:07:45.551 ************************************ 00:07:45.551 START TEST accel_dualcast 00:07:45.551 ************************************ 00:07:45.551 00:41:52 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dualcast -y 00:07:45.551 00:41:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:45.551 00:41:52 -- accel/accel.sh@17 -- # local accel_module 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:45.551 00:41:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:45.551 00:41:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.551 00:41:52 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:45.551 00:41:52 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:45.551 00:41:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.551 00:41:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.551 00:41:52 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:45.551 00:41:52 -- accel/accel.sh@40 -- # local IFS=, 00:07:45.551 00:41:52 -- accel/accel.sh@41 -- # jq -r . 00:07:45.551 [2024-04-26 00:41:52.523012] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:45.551 [2024-04-26 00:41:52.523082] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid152177 ] 00:07:45.551 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.551 [2024-04-26 00:41:52.578382] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:45.551 [2024-04-26 00:41:52.650090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val=0x1 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.551 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.551 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.551 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=dualcast 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=software 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@22 -- # accel_module=software 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=32 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=32 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=1 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val=Yes 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:45.552 00:41:52 -- accel/accel.sh@20 -- # val= 00:07:45.552 00:41:52 -- accel/accel.sh@21 -- # case "$var" in 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # IFS=: 00:07:45.552 00:41:52 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@20 -- # val= 00:07:46.929 00:41:53 -- accel/accel.sh@21 -- # case "$var" in 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:53 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:46.929 00:41:53 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:07:46.929 00:41:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:46.929 00:07:46.929 real 0m1.350s 00:07:46.929 user 0m1.231s 00:07:46.929 sys 0m0.131s 00:07:46.929 00:41:53 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:46.929 00:41:53 -- common/autotest_common.sh@10 -- # set +x 00:07:46.929 ************************************ 00:07:46.929 END TEST accel_dualcast 00:07:46.929 ************************************ 00:07:46.929 00:41:53 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:46.929 00:41:53 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:46.929 00:41:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.929 00:41:53 -- common/autotest_common.sh@10 -- # set +x 00:07:46.929 ************************************ 00:07:46.929 START TEST accel_compare 00:07:46.929 ************************************ 00:07:46.929 00:41:54 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compare -y 00:07:46.929 00:41:54 -- accel/accel.sh@16 -- # local accel_opc 00:07:46.929 00:41:54 -- accel/accel.sh@17 -- # local accel_module 00:07:46.929 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:46.929 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:46.929 00:41:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:46.929 00:41:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:46.929 00:41:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.929 00:41:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:46.929 00:41:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:46.929 00:41:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.929 00:41:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.929 00:41:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:46.929 00:41:54 -- accel/accel.sh@40 -- # local IFS=, 00:07:46.929 00:41:54 -- accel/accel.sh@41 -- # jq -r . 00:07:46.929 [2024-04-26 00:41:54.034762] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:46.929 [2024-04-26 00:41:54.034819] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid152468 ] 00:07:46.929 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.929 [2024-04-26 00:41:54.089559] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:47.187 [2024-04-26 00:41:54.163421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=0x1 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=compare 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@23 -- # accel_opc=compare 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=software 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@22 -- # accel_module=software 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=32 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=32 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=1 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val=Yes 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.187 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.187 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.187 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.188 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:47.188 00:41:54 -- accel/accel.sh@20 -- # val= 00:07:47.188 00:41:54 -- accel/accel.sh@21 -- # case "$var" in 00:07:47.188 00:41:54 -- accel/accel.sh@19 -- # IFS=: 00:07:47.188 00:41:54 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:48.567 00:41:55 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:07:48.567 00:41:55 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:48.567 00:07:48.567 real 0m1.347s 00:07:48.567 user 0m1.246s 00:07:48.567 sys 0m0.112s 00:07:48.567 00:41:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:48.567 00:41:55 -- common/autotest_common.sh@10 -- # set +x 00:07:48.567 ************************************ 00:07:48.567 END TEST accel_compare 00:07:48.567 ************************************ 00:07:48.567 00:41:55 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:48.567 00:41:55 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:48.567 00:41:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.567 00:41:55 -- common/autotest_common.sh@10 -- # set +x 00:07:48.567 ************************************ 00:07:48.567 START TEST accel_xor 00:07:48.567 ************************************ 00:07:48.567 00:41:55 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y 00:07:48.567 00:41:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:48.567 00:41:55 -- accel/accel.sh@17 -- # local accel_module 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:48.567 00:41:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:48.567 00:41:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.567 00:41:55 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:48.567 00:41:55 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:48.567 00:41:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.567 00:41:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.567 00:41:55 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:48.567 00:41:55 -- accel/accel.sh@40 -- # local IFS=, 00:07:48.567 00:41:55 -- accel/accel.sh@41 -- # jq -r . 00:07:48.567 [2024-04-26 00:41:55.552292] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:48.567 [2024-04-26 00:41:55.552347] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid152762 ] 00:07:48.567 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.567 [2024-04-26 00:41:55.605573] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.567 [2024-04-26 00:41:55.672161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.567 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.567 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.567 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=0x1 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=xor 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=2 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=software 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@22 -- # accel_module=software 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=32 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=32 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=1 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val=Yes 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:48.568 00:41:55 -- accel/accel.sh@20 -- # val= 00:07:48.568 00:41:55 -- accel/accel.sh@21 -- # case "$var" in 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # IFS=: 00:07:48.568 00:41:55 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@20 -- # val= 00:07:49.945 00:41:56 -- accel/accel.sh@21 -- # case "$var" in 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:56 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:56 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:49.945 00:41:56 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:49.945 00:41:56 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:49.945 00:07:49.945 real 0m1.338s 00:07:49.945 user 0m1.240s 00:07:49.945 sys 0m0.112s 00:07:49.945 00:41:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:49.945 00:41:56 -- common/autotest_common.sh@10 -- # set +x 00:07:49.945 ************************************ 00:07:49.945 END TEST accel_xor 00:07:49.945 ************************************ 00:07:49.945 00:41:56 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:49.945 00:41:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:49.945 00:41:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.945 00:41:56 -- common/autotest_common.sh@10 -- # set +x 00:07:49.945 ************************************ 00:07:49.945 START TEST accel_xor 00:07:49.945 ************************************ 00:07:49.945 00:41:57 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w xor -y -x 3 00:07:49.945 00:41:57 -- accel/accel.sh@16 -- # local accel_opc 00:07:49.945 00:41:57 -- accel/accel.sh@17 -- # local accel_module 00:07:49.945 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:49.945 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:49.945 00:41:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:49.945 00:41:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:49.945 00:41:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:49.945 00:41:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:49.945 00:41:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:49.945 00:41:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:49.945 00:41:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:49.945 00:41:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:49.945 00:41:57 -- accel/accel.sh@40 -- # local IFS=, 00:07:49.945 00:41:57 -- accel/accel.sh@41 -- # jq -r . 00:07:49.945 [2024-04-26 00:41:57.048128] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:49.945 [2024-04-26 00:41:57.048172] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid153067 ] 00:07:49.945 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.945 [2024-04-26 00:41:57.099487] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.204 [2024-04-26 00:41:57.165893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val=0x1 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.204 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.204 00:41:57 -- accel/accel.sh@20 -- # val=xor 00:07:50.204 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.204 00:41:57 -- accel/accel.sh@23 -- # accel_opc=xor 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=3 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=software 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@22 -- # accel_module=software 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=32 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=32 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=1 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val=Yes 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:50.205 00:41:57 -- accel/accel.sh@20 -- # val= 00:07:50.205 00:41:57 -- accel/accel.sh@21 -- # case "$var" in 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # IFS=: 00:07:50.205 00:41:57 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:51.581 00:41:58 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:07:51.581 00:41:58 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:51.581 00:07:51.581 real 0m1.336s 00:07:51.581 user 0m1.237s 00:07:51.581 sys 0m0.111s 00:07:51.581 00:41:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:51.581 00:41:58 -- common/autotest_common.sh@10 -- # set +x 00:07:51.581 ************************************ 00:07:51.581 END TEST accel_xor 00:07:51.581 ************************************ 00:07:51.581 00:41:58 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:51.581 00:41:58 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:51.581 00:41:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.581 00:41:58 -- common/autotest_common.sh@10 -- # set +x 00:07:51.581 ************************************ 00:07:51.581 START TEST accel_dif_verify 00:07:51.581 ************************************ 00:07:51.581 00:41:58 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_verify 00:07:51.581 00:41:58 -- accel/accel.sh@16 -- # local accel_opc 00:07:51.581 00:41:58 -- accel/accel.sh@17 -- # local accel_module 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:51.581 00:41:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:51.581 00:41:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:51.581 00:41:58 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:51.581 00:41:58 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:51.581 00:41:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:51.581 00:41:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:51.581 00:41:58 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:51.581 00:41:58 -- accel/accel.sh@40 -- # local IFS=, 00:07:51.581 00:41:58 -- accel/accel.sh@41 -- # jq -r . 00:07:51.581 [2024-04-26 00:41:58.553019] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:51.581 [2024-04-26 00:41:58.553085] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid153390 ] 00:07:51.581 EAL: No free 2048 kB hugepages reported on node 1 00:07:51.581 [2024-04-26 00:41:58.607093] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:51.581 [2024-04-26 00:41:58.680789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val=0x1 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.581 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.581 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.581 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=dif_verify 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=software 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@22 -- # accel_module=software 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=32 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=32 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=1 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val=No 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:51.582 00:41:58 -- accel/accel.sh@20 -- # val= 00:07:51.582 00:41:58 -- accel/accel.sh@21 -- # case "$var" in 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # IFS=: 00:07:51.582 00:41:58 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@20 -- # val= 00:07:52.955 00:41:59 -- accel/accel.sh@21 -- # case "$var" in 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:41:59 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:41:59 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:52.955 00:41:59 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:07:52.955 00:41:59 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:52.955 00:07:52.955 real 0m1.349s 00:07:52.955 user 0m1.249s 00:07:52.955 sys 0m0.115s 00:07:52.955 00:41:59 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:52.955 00:41:59 -- common/autotest_common.sh@10 -- # set +x 00:07:52.955 ************************************ 00:07:52.955 END TEST accel_dif_verify 00:07:52.955 ************************************ 00:07:52.955 00:41:59 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:52.955 00:41:59 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:52.955 00:41:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:52.955 00:41:59 -- common/autotest_common.sh@10 -- # set +x 00:07:52.955 ************************************ 00:07:52.955 START TEST accel_dif_generate 00:07:52.955 ************************************ 00:07:52.955 00:42:00 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate 00:07:52.955 00:42:00 -- accel/accel.sh@16 -- # local accel_opc 00:07:52.955 00:42:00 -- accel/accel.sh@17 -- # local accel_module 00:07:52.955 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:52.955 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:52.955 00:42:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:52.955 00:42:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:52.955 00:42:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:52.955 00:42:00 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:52.955 00:42:00 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:52.955 00:42:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:52.955 00:42:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:52.955 00:42:00 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:52.955 00:42:00 -- accel/accel.sh@40 -- # local IFS=, 00:07:52.955 00:42:00 -- accel/accel.sh@41 -- # jq -r . 00:07:52.955 [2024-04-26 00:42:00.061825] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:52.955 [2024-04-26 00:42:00.061887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid153727 ] 00:07:52.955 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.955 [2024-04-26 00:42:00.117864] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:53.214 [2024-04-26 00:42:00.190718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=0x1 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=dif_generate 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val='512 bytes' 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val='8 bytes' 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=software 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@22 -- # accel_module=software 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=32 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=32 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=1 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val=No 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:53.214 00:42:00 -- accel/accel.sh@20 -- # val= 00:07:53.214 00:42:00 -- accel/accel.sh@21 -- # case "$var" in 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # IFS=: 00:07:53.214 00:42:00 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:54.590 00:42:01 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:07:54.590 00:42:01 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:54.590 00:07:54.590 real 0m1.350s 00:07:54.590 user 0m1.246s 00:07:54.590 sys 0m0.116s 00:07:54.590 00:42:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:54.590 00:42:01 -- common/autotest_common.sh@10 -- # set +x 00:07:54.590 ************************************ 00:07:54.590 END TEST accel_dif_generate 00:07:54.590 ************************************ 00:07:54.590 00:42:01 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:54.590 00:42:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:54.590 00:42:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.590 00:42:01 -- common/autotest_common.sh@10 -- # set +x 00:07:54.590 ************************************ 00:07:54.590 START TEST accel_dif_generate_copy 00:07:54.590 ************************************ 00:07:54.590 00:42:01 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w dif_generate_copy 00:07:54.590 00:42:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:54.590 00:42:01 -- accel/accel.sh@17 -- # local accel_module 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:54.590 00:42:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:54.590 00:42:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:54.590 00:42:01 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:54.590 00:42:01 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:54.590 00:42:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:54.590 00:42:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:54.590 00:42:01 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:54.590 00:42:01 -- accel/accel.sh@40 -- # local IFS=, 00:07:54.590 00:42:01 -- accel/accel.sh@41 -- # jq -r . 00:07:54.590 [2024-04-26 00:42:01.570382] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:54.590 [2024-04-26 00:42:01.570444] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154161 ] 00:07:54.590 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.590 [2024-04-26 00:42:01.624467] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.590 [2024-04-26 00:42:01.691710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=0x1 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=software 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@22 -- # accel_module=software 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=32 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=32 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=1 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val=No 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:54.590 00:42:01 -- accel/accel.sh@20 -- # val= 00:07:54.590 00:42:01 -- accel/accel.sh@21 -- # case "$var" in 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # IFS=: 00:07:54.590 00:42:01 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@20 -- # val= 00:07:55.966 00:42:02 -- accel/accel.sh@21 -- # case "$var" in 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:02 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:02 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:55.966 00:42:02 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:07:55.966 00:42:02 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:55.966 00:07:55.966 real 0m1.342s 00:07:55.966 user 0m1.247s 00:07:55.966 sys 0m0.107s 00:07:55.966 00:42:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:55.966 00:42:02 -- common/autotest_common.sh@10 -- # set +x 00:07:55.966 ************************************ 00:07:55.966 END TEST accel_dif_generate_copy 00:07:55.966 ************************************ 00:07:55.966 00:42:02 -- accel/accel.sh@115 -- # [[ y == y ]] 00:07:55.966 00:42:02 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:55.966 00:42:02 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:55.966 00:42:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.966 00:42:02 -- common/autotest_common.sh@10 -- # set +x 00:07:55.966 ************************************ 00:07:55.966 START TEST accel_comp 00:07:55.966 ************************************ 00:07:55.966 00:42:03 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:55.966 00:42:03 -- accel/accel.sh@16 -- # local accel_opc 00:07:55.966 00:42:03 -- accel/accel.sh@17 -- # local accel_module 00:07:55.966 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:55.966 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:55.966 00:42:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:55.966 00:42:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:55.966 00:42:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:55.966 00:42:03 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:55.966 00:42:03 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:55.966 00:42:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:55.966 00:42:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:55.966 00:42:03 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:55.966 00:42:03 -- accel/accel.sh@40 -- # local IFS=, 00:07:55.966 00:42:03 -- accel/accel.sh@41 -- # jq -r . 00:07:55.966 [2024-04-26 00:42:03.077743] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:55.966 [2024-04-26 00:42:03.077801] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid154509 ] 00:07:55.966 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.966 [2024-04-26 00:42:03.132144] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.225 [2024-04-26 00:42:03.198958] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=0x1 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=compress 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@23 -- # accel_opc=compress 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=software 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@22 -- # accel_module=software 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=32 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=32 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=1 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val=No 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:56.225 00:42:03 -- accel/accel.sh@20 -- # val= 00:07:56.225 00:42:03 -- accel/accel.sh@21 -- # case "$var" in 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # IFS=: 00:07:56.225 00:42:03 -- accel/accel.sh@19 -- # read -r var val 00:07:57.601 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.601 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.601 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.601 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.601 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.601 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.601 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.601 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:57.602 00:42:04 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:07:57.602 00:42:04 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:57.602 00:07:57.602 real 0m1.349s 00:07:57.602 user 0m1.246s 00:07:57.602 sys 0m0.115s 00:07:57.602 00:42:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:57.602 00:42:04 -- common/autotest_common.sh@10 -- # set +x 00:07:57.602 ************************************ 00:07:57.602 END TEST accel_comp 00:07:57.602 ************************************ 00:07:57.602 00:42:04 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:57.602 00:42:04 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:57.602 00:42:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.602 00:42:04 -- common/autotest_common.sh@10 -- # set +x 00:07:57.602 ************************************ 00:07:57.602 START TEST accel_decomp 00:07:57.602 ************************************ 00:07:57.602 00:42:04 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:57.602 00:42:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:57.602 00:42:04 -- accel/accel.sh@17 -- # local accel_module 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:57.602 00:42:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:57.602 00:42:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:57.602 00:42:04 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:57.602 00:42:04 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:57.602 00:42:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:57.602 00:42:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:57.602 00:42:04 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:57.602 00:42:04 -- accel/accel.sh@40 -- # local IFS=, 00:07:57.602 00:42:04 -- accel/accel.sh@41 -- # jq -r . 00:07:57.602 [2024-04-26 00:42:04.584053] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:57.602 [2024-04-26 00:42:04.584109] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid155043 ] 00:07:57.602 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.602 [2024-04-26 00:42:04.637502] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:57.602 [2024-04-26 00:42:04.709092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=0x1 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=decompress 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=software 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@22 -- # accel_module=software 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=32 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=32 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=1 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val=Yes 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:57.602 00:42:04 -- accel/accel.sh@20 -- # val= 00:07:57.602 00:42:04 -- accel/accel.sh@21 -- # case "$var" in 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # IFS=: 00:07:57.602 00:42:04 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@20 -- # val= 00:07:58.993 00:42:05 -- accel/accel.sh@21 -- # case "$var" in 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:05 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:05 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:58.993 00:42:05 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:58.993 00:42:05 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:58.993 00:07:58.993 real 0m1.349s 00:07:58.993 user 0m1.243s 00:07:58.993 sys 0m0.119s 00:07:58.993 00:42:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:07:58.993 00:42:05 -- common/autotest_common.sh@10 -- # set +x 00:07:58.993 ************************************ 00:07:58.993 END TEST accel_decomp 00:07:58.993 ************************************ 00:07:58.993 00:42:05 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.993 00:42:05 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:58.993 00:42:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:58.993 00:42:05 -- common/autotest_common.sh@10 -- # set +x 00:07:58.993 ************************************ 00:07:58.993 START TEST accel_decmop_full 00:07:58.993 ************************************ 00:07:58.993 00:42:06 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.993 00:42:06 -- accel/accel.sh@16 -- # local accel_opc 00:07:58.993 00:42:06 -- accel/accel.sh@17 -- # local accel_module 00:07:58.993 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:58.993 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:58.993 00:42:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.993 00:42:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:58.993 00:42:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:58.993 00:42:06 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:58.993 00:42:06 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:58.993 00:42:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:58.993 00:42:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:58.993 00:42:06 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:58.993 00:42:06 -- accel/accel.sh@40 -- # local IFS=, 00:07:58.993 00:42:06 -- accel/accel.sh@41 -- # jq -r . 00:07:58.993 [2024-04-26 00:42:06.094150] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:07:58.993 [2024-04-26 00:42:06.094195] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid155641 ] 00:07:58.993 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.993 [2024-04-26 00:42:06.144675] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:59.252 [2024-04-26 00:42:06.213531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=0x1 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=decompress 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=software 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@22 -- # accel_module=software 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=32 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=32 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=1 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val=Yes 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:07:59.252 00:42:06 -- accel/accel.sh@20 -- # val= 00:07:59.252 00:42:06 -- accel/accel.sh@21 -- # case "$var" in 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # IFS=: 00:07:59.252 00:42:06 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.629 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.629 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.629 00:42:07 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:00.629 00:42:07 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:00.629 00:42:07 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:00.629 00:08:00.629 real 0m1.351s 00:08:00.629 user 0m1.255s 00:08:00.629 sys 0m0.108s 00:08:00.629 00:42:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:00.629 00:42:07 -- common/autotest_common.sh@10 -- # set +x 00:08:00.629 ************************************ 00:08:00.629 END TEST accel_decmop_full 00:08:00.629 ************************************ 00:08:00.630 00:42:07 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.630 00:42:07 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:00.630 00:42:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:00.630 00:42:07 -- common/autotest_common.sh@10 -- # set +x 00:08:00.630 ************************************ 00:08:00.630 START TEST accel_decomp_mcore 00:08:00.630 ************************************ 00:08:00.630 00:42:07 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.630 00:42:07 -- accel/accel.sh@16 -- # local accel_opc 00:08:00.630 00:42:07 -- accel/accel.sh@17 -- # local accel_module 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.630 00:42:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:08:00.630 00:42:07 -- accel/accel.sh@12 -- # build_accel_config 00:08:00.630 00:42:07 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:00.630 00:42:07 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:00.630 00:42:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:00.630 00:42:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:00.630 00:42:07 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:00.630 00:42:07 -- accel/accel.sh@40 -- # local IFS=, 00:08:00.630 00:42:07 -- accel/accel.sh@41 -- # jq -r . 00:08:00.630 [2024-04-26 00:42:07.604976] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:00.630 [2024-04-26 00:42:07.605024] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid155943 ] 00:08:00.630 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.630 [2024-04-26 00:42:07.656232] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:00.630 [2024-04-26 00:42:07.723508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:00.630 [2024-04-26 00:42:07.723604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:00.630 [2024-04-26 00:42:07.723682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:00.630 [2024-04-26 00:42:07.723684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=0xf 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=decompress 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=software 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@22 -- # accel_module=software 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=32 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=32 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=1 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val=Yes 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:00.630 00:42:07 -- accel/accel.sh@20 -- # val= 00:08:00.630 00:42:07 -- accel/accel.sh@21 -- # case "$var" in 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # IFS=: 00:08:00.630 00:42:07 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@20 -- # val= 00:08:02.010 00:42:08 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:08 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:08 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:02.010 00:42:08 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:02.010 00:42:08 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:02.010 00:08:02.010 real 0m1.347s 00:08:02.010 user 0m4.567s 00:08:02.010 sys 0m0.115s 00:08:02.010 00:42:08 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:02.010 00:42:08 -- common/autotest_common.sh@10 -- # set +x 00:08:02.010 ************************************ 00:08:02.010 END TEST accel_decomp_mcore 00:08:02.010 ************************************ 00:08:02.010 00:42:08 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:02.010 00:42:08 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:02.010 00:42:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:02.010 00:42:08 -- common/autotest_common.sh@10 -- # set +x 00:08:02.010 ************************************ 00:08:02.010 START TEST accel_decomp_full_mcore 00:08:02.010 ************************************ 00:08:02.010 00:42:09 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:02.010 00:42:09 -- accel/accel.sh@16 -- # local accel_opc 00:08:02.010 00:42:09 -- accel/accel.sh@17 -- # local accel_module 00:08:02.010 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.010 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.010 00:42:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:02.010 00:42:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:08:02.010 00:42:09 -- accel/accel.sh@12 -- # build_accel_config 00:08:02.010 00:42:09 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:02.010 00:42:09 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:02.010 00:42:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:02.010 00:42:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:02.010 00:42:09 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:02.010 00:42:09 -- accel/accel.sh@40 -- # local IFS=, 00:08:02.010 00:42:09 -- accel/accel.sh@41 -- # jq -r . 00:08:02.010 [2024-04-26 00:42:09.128482] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:02.010 [2024-04-26 00:42:09.128544] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid156230 ] 00:08:02.010 EAL: No free 2048 kB hugepages reported on node 1 00:08:02.010 [2024-04-26 00:42:09.184895] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:02.270 [2024-04-26 00:42:09.262439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:02.270 [2024-04-26 00:42:09.262536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:02.270 [2024-04-26 00:42:09.262612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:02.270 [2024-04-26 00:42:09.262614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=0xf 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=decompress 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val='111250 bytes' 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=software 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@22 -- # accel_module=software 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=32 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=32 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=1 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val=Yes 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:02.270 00:42:09 -- accel/accel.sh@20 -- # val= 00:08:02.270 00:42:09 -- accel/accel.sh@21 -- # case "$var" in 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # IFS=: 00:08:02.270 00:42:09 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.649 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:03.649 00:42:10 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:03.649 00:42:10 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:03.649 00:08:03.649 real 0m1.376s 00:08:03.649 user 0m4.608s 00:08:03.649 sys 0m0.130s 00:08:03.649 00:42:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:03.649 00:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:03.649 ************************************ 00:08:03.649 END TEST accel_decomp_full_mcore 00:08:03.649 ************************************ 00:08:03.649 00:42:10 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:03.649 00:42:10 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:08:03.649 00:42:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.649 00:42:10 -- common/autotest_common.sh@10 -- # set +x 00:08:03.649 ************************************ 00:08:03.649 START TEST accel_decomp_mthread 00:08:03.649 ************************************ 00:08:03.649 00:42:10 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:03.649 00:42:10 -- accel/accel.sh@16 -- # local accel_opc 00:08:03.649 00:42:10 -- accel/accel.sh@17 -- # local accel_module 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.649 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.649 00:42:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:03.649 00:42:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:08:03.649 00:42:10 -- accel/accel.sh@12 -- # build_accel_config 00:08:03.649 00:42:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:03.649 00:42:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:03.650 00:42:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:03.650 00:42:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:03.650 00:42:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:03.650 00:42:10 -- accel/accel.sh@40 -- # local IFS=, 00:08:03.650 00:42:10 -- accel/accel.sh@41 -- # jq -r . 00:08:03.650 [2024-04-26 00:42:10.676500] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:03.650 [2024-04-26 00:42:10.676557] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid156529 ] 00:08:03.650 EAL: No free 2048 kB hugepages reported on node 1 00:08:03.650 [2024-04-26 00:42:10.732741] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:03.650 [2024-04-26 00:42:10.806962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val=0x1 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.908 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.908 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.908 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=decompress 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val='4096 bytes' 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=software 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@22 -- # accel_module=software 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=32 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=32 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=2 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val=Yes 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:03.909 00:42:10 -- accel/accel.sh@20 -- # val= 00:08:03.909 00:42:10 -- accel/accel.sh@21 -- # case "$var" in 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # IFS=: 00:08:03.909 00:42:10 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:11 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:04.846 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:04.846 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:04.846 00:42:12 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:04.846 00:42:12 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:04.846 00:42:12 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:04.846 00:08:04.846 real 0m1.356s 00:08:04.846 user 0m1.248s 00:08:04.846 sys 0m0.122s 00:08:04.846 00:42:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:04.847 00:42:12 -- common/autotest_common.sh@10 -- # set +x 00:08:04.847 ************************************ 00:08:04.847 END TEST accel_decomp_mthread 00:08:04.847 ************************************ 00:08:05.106 00:42:12 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:05.106 00:42:12 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:08:05.106 00:42:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:05.106 00:42:12 -- common/autotest_common.sh@10 -- # set +x 00:08:05.106 ************************************ 00:08:05.106 START TEST accel_deomp_full_mthread 00:08:05.106 ************************************ 00:08:05.106 00:42:12 -- common/autotest_common.sh@1111 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:05.106 00:42:12 -- accel/accel.sh@16 -- # local accel_opc 00:08:05.106 00:42:12 -- accel/accel.sh@17 -- # local accel_module 00:08:05.106 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.106 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.107 00:42:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:05.107 00:42:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:08:05.107 00:42:12 -- accel/accel.sh@12 -- # build_accel_config 00:08:05.107 00:42:12 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:05.107 00:42:12 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:05.107 00:42:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:05.107 00:42:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:05.107 00:42:12 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:05.107 00:42:12 -- accel/accel.sh@40 -- # local IFS=, 00:08:05.107 00:42:12 -- accel/accel.sh@41 -- # jq -r . 00:08:05.107 [2024-04-26 00:42:12.197926] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:05.107 [2024-04-26 00:42:12.197991] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid156813 ] 00:08:05.107 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.107 [2024-04-26 00:42:12.252498] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.366 [2024-04-26 00:42:12.324551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:05.366 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.366 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.366 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=0x1 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=decompress 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@23 -- # accel_opc=decompress 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val='111250 bytes' 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=software 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@22 -- # accel_module=software 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=32 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=32 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=2 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val='1 seconds' 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val=Yes 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:05.367 00:42:12 -- accel/accel.sh@20 -- # val= 00:08:05.367 00:42:12 -- accel/accel.sh@21 -- # case "$var" in 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # IFS=: 00:08:05.367 00:42:12 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@20 -- # val= 00:08:06.749 00:42:13 -- accel/accel.sh@21 -- # case "$var" in 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # IFS=: 00:08:06.749 00:42:13 -- accel/accel.sh@19 -- # read -r var val 00:08:06.749 00:42:13 -- accel/accel.sh@27 -- # [[ -n software ]] 00:08:06.749 00:42:13 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:08:06.749 00:42:13 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:08:06.749 00:08:06.749 real 0m1.370s 00:08:06.749 user 0m1.269s 00:08:06.749 sys 0m0.114s 00:08:06.749 00:42:13 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:06.749 00:42:13 -- common/autotest_common.sh@10 -- # set +x 00:08:06.749 ************************************ 00:08:06.749 END TEST accel_deomp_full_mthread 00:08:06.749 ************************************ 00:08:06.749 00:42:13 -- accel/accel.sh@124 -- # [[ n == y ]] 00:08:06.749 00:42:13 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:06.749 00:42:13 -- accel/accel.sh@137 -- # build_accel_config 00:08:06.749 00:42:13 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:06.749 00:42:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:06.749 00:42:13 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:08:06.749 00:42:13 -- common/autotest_common.sh@10 -- # set +x 00:08:06.749 00:42:13 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:08:06.749 00:42:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:08:06.749 00:42:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:08:06.749 00:42:13 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:08:06.749 00:42:13 -- accel/accel.sh@40 -- # local IFS=, 00:08:06.749 00:42:13 -- accel/accel.sh@41 -- # jq -r . 00:08:06.749 ************************************ 00:08:06.749 START TEST accel_dif_functional_tests 00:08:06.749 ************************************ 00:08:06.749 00:42:13 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:08:06.749 [2024-04-26 00:42:13.735929] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:06.749 [2024-04-26 00:42:13.735968] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid157108 ] 00:08:06.749 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.749 [2024-04-26 00:42:13.784714] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:08:06.749 [2024-04-26 00:42:13.854151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:06.749 [2024-04-26 00:42:13.854236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:06.749 [2024-04-26 00:42:13.854238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:06.749 00:08:06.749 00:08:06.749 CUnit - A unit testing framework for C - Version 2.1-3 00:08:06.749 http://cunit.sourceforge.net/ 00:08:06.749 00:08:06.749 00:08:06.749 Suite: accel_dif 00:08:06.749 Test: verify: DIF generated, GUARD check ...passed 00:08:06.749 Test: verify: DIF generated, APPTAG check ...passed 00:08:06.749 Test: verify: DIF generated, REFTAG check ...passed 00:08:06.749 Test: verify: DIF not generated, GUARD check ...[2024-04-26 00:42:13.920371] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:06.749 [2024-04-26 00:42:13.920413] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:08:06.749 passed 00:08:06.749 Test: verify: DIF not generated, APPTAG check ...[2024-04-26 00:42:13.920442] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:06.749 [2024-04-26 00:42:13.920455] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:08:06.749 passed 00:08:06.749 Test: verify: DIF not generated, REFTAG check ...[2024-04-26 00:42:13.920470] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:06.749 [2024-04-26 00:42:13.920484] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:08:06.749 passed 00:08:06.749 Test: verify: APPTAG correct, APPTAG check ...passed 00:08:06.749 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-26 00:42:13.920521] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:08:06.749 passed 00:08:06.749 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:08:06.749 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:08:06.749 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:08:06.749 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-26 00:42:13.920613] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:08:06.749 passed 00:08:06.749 Test: generate copy: DIF generated, GUARD check ...passed 00:08:06.749 Test: generate copy: DIF generated, APTTAG check ...passed 00:08:06.749 Test: generate copy: DIF generated, REFTAG check ...passed 00:08:06.749 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:08:06.749 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:08:06.749 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:08:06.749 Test: generate copy: iovecs-len validate ...[2024-04-26 00:42:13.920761] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:08:06.749 passed 00:08:06.749 Test: generate copy: buffer alignment validate ...passed 00:08:06.749 00:08:06.749 Run Summary: Type Total Ran Passed Failed Inactive 00:08:06.749 suites 1 1 n/a 0 0 00:08:06.749 tests 20 20 20 0 0 00:08:06.749 asserts 204 204 204 0 n/a 00:08:06.749 00:08:06.749 Elapsed time = 0.002 seconds 00:08:07.009 00:08:07.009 real 0m0.407s 00:08:07.009 user 0m0.581s 00:08:07.009 sys 0m0.135s 00:08:07.009 00:42:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:07.009 00:42:14 -- common/autotest_common.sh@10 -- # set +x 00:08:07.009 ************************************ 00:08:07.009 END TEST accel_dif_functional_tests 00:08:07.009 ************************************ 00:08:07.009 00:08:07.009 real 0m33.780s 00:08:07.009 user 0m35.998s 00:08:07.009 sys 0m5.346s 00:08:07.009 00:42:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:07.009 00:42:14 -- common/autotest_common.sh@10 -- # set +x 00:08:07.009 ************************************ 00:08:07.009 END TEST accel 00:08:07.009 ************************************ 00:08:07.009 00:42:14 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:07.009 00:42:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:07.009 00:42:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:07.009 00:42:14 -- common/autotest_common.sh@10 -- # set +x 00:08:07.268 ************************************ 00:08:07.268 START TEST accel_rpc 00:08:07.268 ************************************ 00:08:07.268 00:42:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:08:07.268 * Looking for test storage... 00:08:07.268 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:08:07.268 00:42:14 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:08:07.268 00:42:14 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=157308 00:08:07.268 00:42:14 -- accel/accel_rpc.sh@15 -- # waitforlisten 157308 00:08:07.268 00:42:14 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:08:07.268 00:42:14 -- common/autotest_common.sh@817 -- # '[' -z 157308 ']' 00:08:07.268 00:42:14 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:07.268 00:42:14 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:07.268 00:42:14 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:07.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:07.268 00:42:14 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:07.268 00:42:14 -- common/autotest_common.sh@10 -- # set +x 00:08:07.268 [2024-04-26 00:42:14.427879] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:07.268 [2024-04-26 00:42:14.427924] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid157308 ] 00:08:07.268 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.527 [2024-04-26 00:42:14.477280] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:07.527 [2024-04-26 00:42:14.544480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.093 00:42:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:08.093 00:42:15 -- common/autotest_common.sh@850 -- # return 0 00:08:08.093 00:42:15 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:08:08.093 00:42:15 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:08:08.093 00:42:15 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:08:08.093 00:42:15 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:08:08.093 00:42:15 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:08:08.093 00:42:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:08.093 00:42:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.093 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.352 ************************************ 00:08:08.352 START TEST accel_assign_opcode 00:08:08.352 ************************************ 00:08:08.352 00:42:15 -- common/autotest_common.sh@1111 -- # accel_assign_opcode_test_suite 00:08:08.352 00:42:15 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:08:08.352 00:42:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.352 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.353 [2024-04-26 00:42:15.334740] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:08:08.353 00:42:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.353 00:42:15 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:08:08.353 00:42:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.353 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.353 [2024-04-26 00:42:15.342749] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:08:08.353 00:42:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.353 00:42:15 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:08:08.353 00:42:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.353 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.353 00:42:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.353 00:42:15 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:08:08.353 00:42:15 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:08:08.353 00:42:15 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:08.353 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.353 00:42:15 -- accel/accel_rpc.sh@42 -- # grep software 00:08:08.353 00:42:15 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:08.612 software 00:08:08.612 00:08:08.612 real 0m0.226s 00:08:08.612 user 0m0.048s 00:08:08.612 sys 0m0.008s 00:08:08.612 00:42:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:08.612 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.612 ************************************ 00:08:08.612 END TEST accel_assign_opcode 00:08:08.612 ************************************ 00:08:08.612 00:42:15 -- accel/accel_rpc.sh@55 -- # killprocess 157308 00:08:08.612 00:42:15 -- common/autotest_common.sh@936 -- # '[' -z 157308 ']' 00:08:08.612 00:42:15 -- common/autotest_common.sh@940 -- # kill -0 157308 00:08:08.612 00:42:15 -- common/autotest_common.sh@941 -- # uname 00:08:08.612 00:42:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:08.612 00:42:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 157308 00:08:08.612 00:42:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:08.612 00:42:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:08.612 00:42:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 157308' 00:08:08.612 killing process with pid 157308 00:08:08.612 00:42:15 -- common/autotest_common.sh@955 -- # kill 157308 00:08:08.612 00:42:15 -- common/autotest_common.sh@960 -- # wait 157308 00:08:08.871 00:08:08.871 real 0m1.666s 00:08:08.871 user 0m1.772s 00:08:08.871 sys 0m0.441s 00:08:08.871 00:42:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:08.871 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:08.871 ************************************ 00:08:08.871 END TEST accel_rpc 00:08:08.871 ************************************ 00:08:08.871 00:42:15 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:08:08.871 00:42:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:08.871 00:42:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.871 00:42:15 -- common/autotest_common.sh@10 -- # set +x 00:08:09.130 ************************************ 00:08:09.130 START TEST app_cmdline 00:08:09.130 ************************************ 00:08:09.130 00:42:16 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:08:09.130 * Looking for test storage... 00:08:09.130 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:09.130 00:42:16 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:08:09.130 00:42:16 -- app/cmdline.sh@17 -- # spdk_tgt_pid=157780 00:08:09.130 00:42:16 -- app/cmdline.sh@18 -- # waitforlisten 157780 00:08:09.130 00:42:16 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:08:09.131 00:42:16 -- common/autotest_common.sh@817 -- # '[' -z 157780 ']' 00:08:09.131 00:42:16 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:09.131 00:42:16 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:09.131 00:42:16 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:09.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:09.131 00:42:16 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:09.131 00:42:16 -- common/autotest_common.sh@10 -- # set +x 00:08:09.131 [2024-04-26 00:42:16.245078] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:09.131 [2024-04-26 00:42:16.245125] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid157780 ] 00:08:09.131 EAL: No free 2048 kB hugepages reported on node 1 00:08:09.131 [2024-04-26 00:42:16.295686] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:09.389 [2024-04-26 00:42:16.363747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:09.957 00:42:17 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:09.957 00:42:17 -- common/autotest_common.sh@850 -- # return 0 00:08:09.957 00:42:17 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:08:10.217 { 00:08:10.217 "version": "SPDK v24.05-pre git sha1 06472fb6d", 00:08:10.217 "fields": { 00:08:10.217 "major": 24, 00:08:10.217 "minor": 5, 00:08:10.217 "patch": 0, 00:08:10.217 "suffix": "-pre", 00:08:10.217 "commit": "06472fb6d" 00:08:10.217 } 00:08:10.217 } 00:08:10.217 00:42:17 -- app/cmdline.sh@22 -- # expected_methods=() 00:08:10.217 00:42:17 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:08:10.217 00:42:17 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:08:10.217 00:42:17 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:08:10.217 00:42:17 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:08:10.217 00:42:17 -- app/cmdline.sh@26 -- # sort 00:08:10.217 00:42:17 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:08:10.217 00:42:17 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:10.217 00:42:17 -- common/autotest_common.sh@10 -- # set +x 00:08:10.217 00:42:17 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:10.217 00:42:17 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:08:10.217 00:42:17 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:08:10.217 00:42:17 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:10.217 00:42:17 -- common/autotest_common.sh@638 -- # local es=0 00:08:10.217 00:42:17 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:10.217 00:42:17 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:10.217 00:42:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:10.217 00:42:17 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:10.217 00:42:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:10.217 00:42:17 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:10.217 00:42:17 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:08:10.217 00:42:17 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:08:10.217 00:42:17 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:08:10.217 00:42:17 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:08:10.217 request: 00:08:10.217 { 00:08:10.217 "method": "env_dpdk_get_mem_stats", 00:08:10.217 "req_id": 1 00:08:10.217 } 00:08:10.217 Got JSON-RPC error response 00:08:10.217 response: 00:08:10.217 { 00:08:10.217 "code": -32601, 00:08:10.217 "message": "Method not found" 00:08:10.217 } 00:08:10.217 00:42:17 -- common/autotest_common.sh@641 -- # es=1 00:08:10.217 00:42:17 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:08:10.217 00:42:17 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:08:10.217 00:42:17 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:08:10.217 00:42:17 -- app/cmdline.sh@1 -- # killprocess 157780 00:08:10.217 00:42:17 -- common/autotest_common.sh@936 -- # '[' -z 157780 ']' 00:08:10.217 00:42:17 -- common/autotest_common.sh@940 -- # kill -0 157780 00:08:10.217 00:42:17 -- common/autotest_common.sh@941 -- # uname 00:08:10.217 00:42:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:10.217 00:42:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 157780 00:08:10.477 00:42:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:10.477 00:42:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:10.477 00:42:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 157780' 00:08:10.477 killing process with pid 157780 00:08:10.477 00:42:17 -- common/autotest_common.sh@955 -- # kill 157780 00:08:10.477 00:42:17 -- common/autotest_common.sh@960 -- # wait 157780 00:08:10.737 00:08:10.738 real 0m1.648s 00:08:10.738 user 0m1.944s 00:08:10.738 sys 0m0.407s 00:08:10.738 00:42:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.738 00:42:17 -- common/autotest_common.sh@10 -- # set +x 00:08:10.738 ************************************ 00:08:10.738 END TEST app_cmdline 00:08:10.738 ************************************ 00:08:10.738 00:42:17 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:08:10.738 00:42:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:08:10.738 00:42:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.738 00:42:17 -- common/autotest_common.sh@10 -- # set +x 00:08:10.738 ************************************ 00:08:10.738 START TEST version 00:08:10.738 ************************************ 00:08:10.998 00:42:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:08:10.998 * Looking for test storage... 00:08:10.998 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:10.998 00:42:17 -- app/version.sh@17 -- # get_header_version major 00:08:10.998 00:42:18 -- app/version.sh@14 -- # cut -f2 00:08:10.998 00:42:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:10.998 00:42:18 -- app/version.sh@14 -- # tr -d '"' 00:08:10.998 00:42:18 -- app/version.sh@17 -- # major=24 00:08:10.998 00:42:18 -- app/version.sh@18 -- # get_header_version minor 00:08:10.998 00:42:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:10.998 00:42:18 -- app/version.sh@14 -- # cut -f2 00:08:10.998 00:42:18 -- app/version.sh@14 -- # tr -d '"' 00:08:10.998 00:42:18 -- app/version.sh@18 -- # minor=5 00:08:10.998 00:42:18 -- app/version.sh@19 -- # get_header_version patch 00:08:10.998 00:42:18 -- app/version.sh@14 -- # cut -f2 00:08:10.998 00:42:18 -- app/version.sh@14 -- # tr -d '"' 00:08:10.998 00:42:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:10.998 00:42:18 -- app/version.sh@19 -- # patch=0 00:08:10.998 00:42:18 -- app/version.sh@20 -- # get_header_version suffix 00:08:10.998 00:42:18 -- app/version.sh@14 -- # tr -d '"' 00:08:10.998 00:42:18 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:08:10.998 00:42:18 -- app/version.sh@14 -- # cut -f2 00:08:10.998 00:42:18 -- app/version.sh@20 -- # suffix=-pre 00:08:10.998 00:42:18 -- app/version.sh@22 -- # version=24.5 00:08:10.998 00:42:18 -- app/version.sh@25 -- # (( patch != 0 )) 00:08:10.998 00:42:18 -- app/version.sh@28 -- # version=24.5rc0 00:08:10.998 00:42:18 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:10.998 00:42:18 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:08:10.998 00:42:18 -- app/version.sh@30 -- # py_version=24.5rc0 00:08:10.998 00:42:18 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:08:10.998 00:08:10.998 real 0m0.139s 00:08:10.998 user 0m0.062s 00:08:10.998 sys 0m0.102s 00:08:10.998 00:42:18 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:10.998 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:10.998 ************************************ 00:08:10.998 END TEST version 00:08:10.998 ************************************ 00:08:10.998 00:42:18 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@194 -- # uname -s 00:08:10.998 00:42:18 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:08:10.998 00:42:18 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:10.998 00:42:18 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:08:10.998 00:42:18 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@258 -- # timing_exit lib 00:08:10.998 00:42:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:10.998 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:10.998 00:42:18 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:08:10.998 00:42:18 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:08:10.998 00:42:18 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:10.998 00:42:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:10.998 00:42:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.998 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:11.258 ************************************ 00:08:11.258 START TEST nvmf_rdma 00:08:11.258 ************************************ 00:08:11.258 00:42:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:08:11.258 * Looking for test storage... 00:08:11.258 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@10 -- # uname -s 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:11.258 00:42:18 -- nvmf/common.sh@7 -- # uname -s 00:08:11.258 00:42:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:11.258 00:42:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:11.258 00:42:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:11.258 00:42:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:11.258 00:42:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:11.258 00:42:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:11.258 00:42:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:11.258 00:42:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:11.258 00:42:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:11.258 00:42:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:11.258 00:42:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:11.258 00:42:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:11.258 00:42:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:11.258 00:42:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:11.258 00:42:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:11.258 00:42:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:11.258 00:42:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:11.258 00:42:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:11.258 00:42:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:11.258 00:42:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:11.258 00:42:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.258 00:42:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.258 00:42:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.258 00:42:18 -- paths/export.sh@5 -- # export PATH 00:08:11.258 00:42:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.258 00:42:18 -- nvmf/common.sh@47 -- # : 0 00:08:11.258 00:42:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:11.258 00:42:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:11.258 00:42:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:11.258 00:42:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:11.258 00:42:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:11.258 00:42:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:11.258 00:42:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:11.258 00:42:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:08:11.258 00:42:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:11.258 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:08:11.258 00:42:18 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:11.258 00:42:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:11.258 00:42:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:11.258 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:11.518 ************************************ 00:08:11.518 START TEST nvmf_example 00:08:11.518 ************************************ 00:08:11.518 00:42:18 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:08:11.518 * Looking for test storage... 00:08:11.518 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:11.518 00:42:18 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:11.518 00:42:18 -- nvmf/common.sh@7 -- # uname -s 00:08:11.518 00:42:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:11.518 00:42:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:11.518 00:42:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:11.518 00:42:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:11.518 00:42:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:11.518 00:42:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:11.518 00:42:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:11.518 00:42:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:11.518 00:42:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:11.518 00:42:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:11.519 00:42:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:11.519 00:42:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:11.519 00:42:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:11.519 00:42:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:11.519 00:42:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:11.519 00:42:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:11.519 00:42:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:11.519 00:42:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:11.519 00:42:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:11.519 00:42:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:11.519 00:42:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.519 00:42:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.519 00:42:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.519 00:42:18 -- paths/export.sh@5 -- # export PATH 00:08:11.519 00:42:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:11.519 00:42:18 -- nvmf/common.sh@47 -- # : 0 00:08:11.519 00:42:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:11.519 00:42:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:11.519 00:42:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:11.519 00:42:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:11.519 00:42:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:11.519 00:42:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:11.519 00:42:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:11.519 00:42:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:11.519 00:42:18 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:08:11.519 00:42:18 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:08:11.519 00:42:18 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:08:11.519 00:42:18 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:08:11.519 00:42:18 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:08:11.519 00:42:18 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:08:11.519 00:42:18 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:08:11.519 00:42:18 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:08:11.519 00:42:18 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:11.519 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:11.519 00:42:18 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:08:11.519 00:42:18 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:11.519 00:42:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:11.519 00:42:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:11.519 00:42:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:11.519 00:42:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:11.519 00:42:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:11.519 00:42:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:11.519 00:42:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:11.519 00:42:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:11.519 00:42:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:11.519 00:42:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:11.519 00:42:18 -- common/autotest_common.sh@10 -- # set +x 00:08:16.797 00:42:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:16.797 00:42:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:16.797 00:42:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:16.797 00:42:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:16.797 00:42:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:16.797 00:42:23 -- nvmf/common.sh@295 -- # net_devs=() 00:08:16.797 00:42:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@296 -- # e810=() 00:08:16.797 00:42:23 -- nvmf/common.sh@296 -- # local -ga e810 00:08:16.797 00:42:23 -- nvmf/common.sh@297 -- # x722=() 00:08:16.797 00:42:23 -- nvmf/common.sh@297 -- # local -ga x722 00:08:16.797 00:42:23 -- nvmf/common.sh@298 -- # mlx=() 00:08:16.797 00:42:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:16.797 00:42:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:16.797 00:42:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:16.797 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:16.797 00:42:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:16.797 00:42:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:16.797 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:16.797 00:42:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:16.797 00:42:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.797 00:42:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.797 00:42:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:16.797 Found net devices under 0000:18:00.0: mlx_0_0 00:08:16.797 00:42:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.797 00:42:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.797 00:42:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:16.797 Found net devices under 0000:18:00.1: mlx_0_1 00:08:16.797 00:42:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.797 00:42:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:16.797 00:42:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:16.797 00:42:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:16.797 00:42:23 -- nvmf/common.sh@58 -- # uname 00:08:16.797 00:42:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:16.797 00:42:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:16.797 00:42:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:16.797 00:42:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:16.797 00:42:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:16.797 00:42:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:16.797 00:42:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:16.797 00:42:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:16.797 00:42:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:16.797 00:42:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:16.797 00:42:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:16.797 00:42:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:16.797 00:42:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:16.797 00:42:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:16.797 00:42:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:16.797 00:42:23 -- nvmf/common.sh@105 -- # continue 2 00:08:16.797 00:42:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.797 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:16.797 00:42:23 -- nvmf/common.sh@105 -- # continue 2 00:08:16.797 00:42:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:16.797 00:42:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:16.797 00:42:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.797 00:42:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:16.797 00:42:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:16.797 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:16.797 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:16.797 altname enp24s0f0np0 00:08:16.797 altname ens785f0np0 00:08:16.797 inet 192.168.100.8/24 scope global mlx_0_0 00:08:16.797 valid_lft forever preferred_lft forever 00:08:16.797 00:42:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:16.797 00:42:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:16.797 00:42:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.797 00:42:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.797 00:42:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:16.797 00:42:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:16.797 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:16.797 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:16.797 altname enp24s0f1np1 00:08:16.797 altname ens785f1np1 00:08:16.797 inet 192.168.100.9/24 scope global mlx_0_1 00:08:16.797 valid_lft forever preferred_lft forever 00:08:16.797 00:42:23 -- nvmf/common.sh@411 -- # return 0 00:08:16.797 00:42:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:16.797 00:42:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:16.797 00:42:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:16.797 00:42:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:16.797 00:42:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:16.797 00:42:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:16.797 00:42:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:16.797 00:42:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:16.798 00:42:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:16.798 00:42:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.798 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.798 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:16.798 00:42:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:16.798 00:42:23 -- nvmf/common.sh@105 -- # continue 2 00:08:16.798 00:42:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.798 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.798 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:16.798 00:42:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.798 00:42:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:16.798 00:42:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:16.798 00:42:23 -- nvmf/common.sh@105 -- # continue 2 00:08:16.798 00:42:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:16.798 00:42:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:16.798 00:42:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.798 00:42:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:16.798 00:42:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:16.798 00:42:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.798 00:42:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.798 00:42:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:16.798 192.168.100.9' 00:08:16.798 00:42:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:16.798 192.168.100.9' 00:08:16.798 00:42:23 -- nvmf/common.sh@446 -- # head -n 1 00:08:16.798 00:42:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:16.798 00:42:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:16.798 192.168.100.9' 00:08:16.798 00:42:23 -- nvmf/common.sh@447 -- # tail -n +2 00:08:16.798 00:42:23 -- nvmf/common.sh@447 -- # head -n 1 00:08:16.798 00:42:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:16.798 00:42:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:16.798 00:42:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:16.798 00:42:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:16.798 00:42:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:16.798 00:42:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:16.798 00:42:23 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:16.798 00:42:23 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:16.798 00:42:23 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:16.798 00:42:23 -- common/autotest_common.sh@10 -- # set +x 00:08:16.798 00:42:23 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:08:16.798 00:42:23 -- target/nvmf_example.sh@34 -- # nvmfpid=161440 00:08:16.798 00:42:23 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:16.798 00:42:23 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:16.798 00:42:23 -- target/nvmf_example.sh@36 -- # waitforlisten 161440 00:08:16.798 00:42:23 -- common/autotest_common.sh@817 -- # '[' -z 161440 ']' 00:08:16.798 00:42:23 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:16.798 00:42:23 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:16.798 00:42:23 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:16.798 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:16.798 00:42:23 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:16.798 00:42:23 -- common/autotest_common.sh@10 -- # set +x 00:08:16.798 EAL: No free 2048 kB hugepages reported on node 1 00:08:17.735 00:42:24 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:17.735 00:42:24 -- common/autotest_common.sh@850 -- # return 0 00:08:17.735 00:42:24 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:17.735 00:42:24 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:17.735 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.735 00:42:24 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:17.735 00:42:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.735 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.735 00:42:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.735 00:42:24 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:17.735 00:42:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.735 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.735 00:42:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.735 00:42:24 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:17.735 00:42:24 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:17.735 00:42:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.735 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.735 00:42:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.735 00:42:24 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:17.735 00:42:24 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:17.735 00:42:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.735 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.993 00:42:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.993 00:42:24 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:17.993 00:42:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:17.993 00:42:24 -- common/autotest_common.sh@10 -- # set +x 00:08:17.993 00:42:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:17.993 00:42:24 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:17.993 00:42:24 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:17.993 EAL: No free 2048 kB hugepages reported on node 1 00:08:30.207 Initializing NVMe Controllers 00:08:30.207 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:08:30.207 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:30.207 Initialization complete. Launching workers. 00:08:30.207 ======================================================== 00:08:30.207 Latency(us) 00:08:30.207 Device Information : IOPS MiB/s Average min max 00:08:30.207 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 26029.36 101.68 2458.58 577.16 13995.43 00:08:30.207 ======================================================== 00:08:30.207 Total : 26029.36 101.68 2458.58 577.16 13995.43 00:08:30.207 00:08:30.207 00:42:36 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:30.207 00:42:36 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:30.207 00:42:36 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:30.207 00:42:36 -- nvmf/common.sh@117 -- # sync 00:08:30.207 00:42:36 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:30.207 00:42:36 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:30.207 00:42:36 -- nvmf/common.sh@120 -- # set +e 00:08:30.207 00:42:36 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:30.208 00:42:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:30.208 rmmod nvme_rdma 00:08:30.208 rmmod nvme_fabrics 00:08:30.208 00:42:36 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:30.208 00:42:36 -- nvmf/common.sh@124 -- # set -e 00:08:30.208 00:42:36 -- nvmf/common.sh@125 -- # return 0 00:08:30.208 00:42:36 -- nvmf/common.sh@478 -- # '[' -n 161440 ']' 00:08:30.208 00:42:36 -- nvmf/common.sh@479 -- # killprocess 161440 00:08:30.208 00:42:36 -- common/autotest_common.sh@936 -- # '[' -z 161440 ']' 00:08:30.208 00:42:36 -- common/autotest_common.sh@940 -- # kill -0 161440 00:08:30.208 00:42:36 -- common/autotest_common.sh@941 -- # uname 00:08:30.208 00:42:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:30.208 00:42:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 161440 00:08:30.208 00:42:36 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:30.208 00:42:36 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:30.208 00:42:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 161440' 00:08:30.208 killing process with pid 161440 00:08:30.208 00:42:36 -- common/autotest_common.sh@955 -- # kill 161440 00:08:30.208 00:42:36 -- common/autotest_common.sh@960 -- # wait 161440 00:08:30.208 [2024-04-26 00:42:36.297345] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:30.208 nvmf threads initialize successfully 00:08:30.208 bdev subsystem init successfully 00:08:30.208 created a nvmf target service 00:08:30.208 create targets's poll groups done 00:08:30.208 all subsystems of target started 00:08:30.208 nvmf target is running 00:08:30.208 all subsystems of target stopped 00:08:30.208 destroy targets's poll groups done 00:08:30.208 destroyed the nvmf target service 00:08:30.208 bdev subsystem finish successfully 00:08:30.208 nvmf threads destroy successfully 00:08:30.208 00:42:36 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:30.208 00:42:36 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:30.208 00:42:36 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:30.208 00:42:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:30.208 00:42:36 -- common/autotest_common.sh@10 -- # set +x 00:08:30.208 00:08:30.208 real 0m17.989s 00:08:30.208 user 0m51.264s 00:08:30.208 sys 0m4.392s 00:08:30.208 00:42:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:30.208 00:42:36 -- common/autotest_common.sh@10 -- # set +x 00:08:30.208 ************************************ 00:08:30.208 END TEST nvmf_example 00:08:30.208 ************************************ 00:08:30.208 00:42:36 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:30.208 00:42:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:30.208 00:42:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:30.208 00:42:36 -- common/autotest_common.sh@10 -- # set +x 00:08:30.208 ************************************ 00:08:30.208 START TEST nvmf_filesystem 00:08:30.208 ************************************ 00:08:30.208 00:42:36 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:08:30.208 * Looking for test storage... 00:08:30.208 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.208 00:42:36 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:08:30.208 00:42:36 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:30.208 00:42:36 -- common/autotest_common.sh@34 -- # set -e 00:08:30.208 00:42:36 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:30.208 00:42:36 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:30.208 00:42:36 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:08:30.208 00:42:36 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:30.208 00:42:36 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:08:30.208 00:42:36 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:30.208 00:42:36 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:30.208 00:42:36 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:30.208 00:42:36 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:30.208 00:42:36 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:30.208 00:42:36 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:30.208 00:42:36 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:30.208 00:42:36 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:30.208 00:42:36 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:30.208 00:42:36 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:30.208 00:42:36 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:30.208 00:42:36 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:30.208 00:42:36 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:30.208 00:42:36 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:30.208 00:42:36 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:30.208 00:42:36 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:30.208 00:42:36 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:08:30.208 00:42:36 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:30.208 00:42:36 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:30.208 00:42:36 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:30.208 00:42:36 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:30.208 00:42:36 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:30.208 00:42:36 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:30.208 00:42:36 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:30.208 00:42:36 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:30.208 00:42:36 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:30.208 00:42:36 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:30.208 00:42:36 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:30.208 00:42:36 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:30.208 00:42:36 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:30.208 00:42:36 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:30.208 00:42:36 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:30.208 00:42:36 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:08:30.208 00:42:36 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:30.208 00:42:36 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:30.208 00:42:36 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:30.208 00:42:36 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:30.208 00:42:36 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:30.208 00:42:36 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:30.208 00:42:36 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:30.208 00:42:36 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:30.208 00:42:36 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:30.208 00:42:36 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:30.208 00:42:36 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:30.208 00:42:36 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:30.208 00:42:36 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:08:30.208 00:42:36 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:30.208 00:42:36 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:08:30.208 00:42:36 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:08:30.208 00:42:36 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:08:30.208 00:42:36 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:08:30.208 00:42:36 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:08:30.208 00:42:36 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:08:30.208 00:42:36 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:08:30.208 00:42:36 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:08:30.208 00:42:36 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:08:30.208 00:42:36 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:08:30.208 00:42:36 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:08:30.208 00:42:36 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:08:30.208 00:42:36 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:08:30.208 00:42:36 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:30.208 00:42:36 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:08:30.208 00:42:36 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:08:30.208 00:42:36 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:08:30.208 00:42:36 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:08:30.208 00:42:36 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:08:30.208 00:42:36 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:08:30.208 00:42:36 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:08:30.208 00:42:36 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:08:30.208 00:42:36 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:08:30.208 00:42:36 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:08:30.208 00:42:36 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:08:30.208 00:42:36 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:30.208 00:42:36 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:08:30.208 00:42:36 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:08:30.208 00:42:36 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:08:30.208 00:42:36 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:08:30.208 00:42:36 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:08:30.208 00:42:36 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:08:30.208 00:42:36 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:08:30.208 00:42:36 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:30.208 00:42:36 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:08:30.208 00:42:36 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:30.208 00:42:36 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:30.208 00:42:36 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:30.208 00:42:36 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:30.208 00:42:36 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:30.208 00:42:36 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:30.208 00:42:36 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:30.208 00:42:36 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:08:30.208 00:42:36 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:30.208 #define SPDK_CONFIG_H 00:08:30.208 #define SPDK_CONFIG_APPS 1 00:08:30.208 #define SPDK_CONFIG_ARCH native 00:08:30.208 #undef SPDK_CONFIG_ASAN 00:08:30.208 #undef SPDK_CONFIG_AVAHI 00:08:30.208 #undef SPDK_CONFIG_CET 00:08:30.208 #define SPDK_CONFIG_COVERAGE 1 00:08:30.208 #define SPDK_CONFIG_CROSS_PREFIX 00:08:30.208 #undef SPDK_CONFIG_CRYPTO 00:08:30.208 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:30.208 #undef SPDK_CONFIG_CUSTOMOCF 00:08:30.208 #undef SPDK_CONFIG_DAOS 00:08:30.208 #define SPDK_CONFIG_DAOS_DIR 00:08:30.208 #define SPDK_CONFIG_DEBUG 1 00:08:30.208 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:30.208 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:08:30.208 #define SPDK_CONFIG_DPDK_INC_DIR 00:08:30.208 #define SPDK_CONFIG_DPDK_LIB_DIR 00:08:30.208 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:30.209 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:08:30.209 #define SPDK_CONFIG_EXAMPLES 1 00:08:30.209 #undef SPDK_CONFIG_FC 00:08:30.209 #define SPDK_CONFIG_FC_PATH 00:08:30.209 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:30.209 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:30.209 #undef SPDK_CONFIG_FUSE 00:08:30.209 #undef SPDK_CONFIG_FUZZER 00:08:30.209 #define SPDK_CONFIG_FUZZER_LIB 00:08:30.209 #undef SPDK_CONFIG_GOLANG 00:08:30.209 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:30.209 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:08:30.209 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:30.209 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:08:30.209 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:30.209 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:30.209 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:30.209 #define SPDK_CONFIG_IDXD 1 00:08:30.209 #undef SPDK_CONFIG_IDXD_KERNEL 00:08:30.209 #undef SPDK_CONFIG_IPSEC_MB 00:08:30.209 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:30.209 #define SPDK_CONFIG_ISAL 1 00:08:30.209 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:30.209 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:30.209 #define SPDK_CONFIG_LIBDIR 00:08:30.209 #undef SPDK_CONFIG_LTO 00:08:30.209 #define SPDK_CONFIG_MAX_LCORES 00:08:30.209 #define SPDK_CONFIG_NVME_CUSE 1 00:08:30.209 #undef SPDK_CONFIG_OCF 00:08:30.209 #define SPDK_CONFIG_OCF_PATH 00:08:30.209 #define SPDK_CONFIG_OPENSSL_PATH 00:08:30.209 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:30.209 #define SPDK_CONFIG_PGO_DIR 00:08:30.209 #undef SPDK_CONFIG_PGO_USE 00:08:30.209 #define SPDK_CONFIG_PREFIX /usr/local 00:08:30.209 #undef SPDK_CONFIG_RAID5F 00:08:30.209 #undef SPDK_CONFIG_RBD 00:08:30.209 #define SPDK_CONFIG_RDMA 1 00:08:30.209 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:30.209 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:30.209 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:30.209 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:30.209 #define SPDK_CONFIG_SHARED 1 00:08:30.209 #undef SPDK_CONFIG_SMA 00:08:30.209 #define SPDK_CONFIG_TESTS 1 00:08:30.209 #undef SPDK_CONFIG_TSAN 00:08:30.209 #define SPDK_CONFIG_UBLK 1 00:08:30.209 #define SPDK_CONFIG_UBSAN 1 00:08:30.209 #undef SPDK_CONFIG_UNIT_TESTS 00:08:30.209 #undef SPDK_CONFIG_URING 00:08:30.209 #define SPDK_CONFIG_URING_PATH 00:08:30.209 #undef SPDK_CONFIG_URING_ZNS 00:08:30.209 #undef SPDK_CONFIG_USDT 00:08:30.209 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:30.209 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:30.209 #undef SPDK_CONFIG_VFIO_USER 00:08:30.209 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:30.209 #define SPDK_CONFIG_VHOST 1 00:08:30.209 #define SPDK_CONFIG_VIRTIO 1 00:08:30.209 #undef SPDK_CONFIG_VTUNE 00:08:30.209 #define SPDK_CONFIG_VTUNE_DIR 00:08:30.209 #define SPDK_CONFIG_WERROR 1 00:08:30.209 #define SPDK_CONFIG_WPDK_DIR 00:08:30.209 #undef SPDK_CONFIG_XNVME 00:08:30.209 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:30.209 00:42:36 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:30.209 00:42:36 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:30.209 00:42:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:30.209 00:42:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:30.209 00:42:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:30.209 00:42:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.209 00:42:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.209 00:42:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.209 00:42:36 -- paths/export.sh@5 -- # export PATH 00:08:30.209 00:42:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.209 00:42:36 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:08:30.209 00:42:36 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:08:30.209 00:42:36 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:08:30.209 00:42:36 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:08:30.209 00:42:36 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:30.209 00:42:36 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:08:30.209 00:42:36 -- pm/common@67 -- # TEST_TAG=N/A 00:08:30.209 00:42:36 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:08:30.209 00:42:36 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:08:30.209 00:42:36 -- pm/common@71 -- # uname -s 00:08:30.209 00:42:36 -- pm/common@71 -- # PM_OS=Linux 00:08:30.209 00:42:36 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:08:30.209 00:42:36 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:08:30.209 00:42:36 -- pm/common@76 -- # [[ Linux == Linux ]] 00:08:30.209 00:42:36 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:08:30.209 00:42:36 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:08:30.209 00:42:36 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:08:30.209 00:42:36 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:08:30.209 00:42:36 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:08:30.209 00:42:36 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:08:30.209 00:42:36 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:08:30.209 00:42:36 -- common/autotest_common.sh@57 -- # : 1 00:08:30.209 00:42:36 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:08:30.209 00:42:36 -- common/autotest_common.sh@61 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:30.209 00:42:36 -- common/autotest_common.sh@63 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:08:30.209 00:42:36 -- common/autotest_common.sh@65 -- # : 1 00:08:30.209 00:42:36 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:30.209 00:42:36 -- common/autotest_common.sh@67 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:08:30.209 00:42:36 -- common/autotest_common.sh@69 -- # : 00:08:30.209 00:42:36 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:08:30.209 00:42:36 -- common/autotest_common.sh@71 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:08:30.209 00:42:36 -- common/autotest_common.sh@73 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:08:30.209 00:42:36 -- common/autotest_common.sh@75 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:08:30.209 00:42:36 -- common/autotest_common.sh@77 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:30.209 00:42:36 -- common/autotest_common.sh@79 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:08:30.209 00:42:36 -- common/autotest_common.sh@81 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:08:30.209 00:42:36 -- common/autotest_common.sh@83 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:08:30.209 00:42:36 -- common/autotest_common.sh@85 -- # : 1 00:08:30.209 00:42:36 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:08:30.209 00:42:36 -- common/autotest_common.sh@87 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:08:30.209 00:42:36 -- common/autotest_common.sh@89 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:08:30.209 00:42:36 -- common/autotest_common.sh@91 -- # : 1 00:08:30.209 00:42:36 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:08:30.209 00:42:36 -- common/autotest_common.sh@93 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:08:30.209 00:42:36 -- common/autotest_common.sh@95 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:30.209 00:42:36 -- common/autotest_common.sh@97 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:08:30.209 00:42:36 -- common/autotest_common.sh@99 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:08:30.209 00:42:36 -- common/autotest_common.sh@101 -- # : rdma 00:08:30.209 00:42:36 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:30.209 00:42:36 -- common/autotest_common.sh@103 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:08:30.209 00:42:36 -- common/autotest_common.sh@105 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:08:30.209 00:42:36 -- common/autotest_common.sh@107 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:08:30.209 00:42:36 -- common/autotest_common.sh@109 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:08:30.209 00:42:36 -- common/autotest_common.sh@111 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:08:30.209 00:42:36 -- common/autotest_common.sh@113 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:08:30.209 00:42:36 -- common/autotest_common.sh@115 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:08:30.209 00:42:36 -- common/autotest_common.sh@117 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:30.209 00:42:36 -- common/autotest_common.sh@119 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:08:30.209 00:42:36 -- common/autotest_common.sh@121 -- # : 1 00:08:30.209 00:42:36 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:08:30.209 00:42:36 -- common/autotest_common.sh@123 -- # : 00:08:30.209 00:42:36 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:30.209 00:42:36 -- common/autotest_common.sh@125 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:08:30.209 00:42:36 -- common/autotest_common.sh@127 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:08:30.209 00:42:36 -- common/autotest_common.sh@129 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:08:30.209 00:42:36 -- common/autotest_common.sh@131 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:08:30.209 00:42:36 -- common/autotest_common.sh@133 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:08:30.209 00:42:36 -- common/autotest_common.sh@135 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:08:30.209 00:42:36 -- common/autotest_common.sh@137 -- # : 00:08:30.209 00:42:36 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:08:30.209 00:42:36 -- common/autotest_common.sh@139 -- # : true 00:08:30.209 00:42:36 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:08:30.209 00:42:36 -- common/autotest_common.sh@141 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:08:30.209 00:42:36 -- common/autotest_common.sh@143 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:08:30.209 00:42:36 -- common/autotest_common.sh@145 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:08:30.209 00:42:36 -- common/autotest_common.sh@147 -- # : 0 00:08:30.209 00:42:36 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:08:30.209 00:42:36 -- common/autotest_common.sh@149 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:08:30.210 00:42:36 -- common/autotest_common.sh@151 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:08:30.210 00:42:36 -- common/autotest_common.sh@153 -- # : mlx5 00:08:30.210 00:42:36 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:08:30.210 00:42:36 -- common/autotest_common.sh@155 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:08:30.210 00:42:36 -- common/autotest_common.sh@157 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:08:30.210 00:42:36 -- common/autotest_common.sh@159 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:08:30.210 00:42:36 -- common/autotest_common.sh@161 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:08:30.210 00:42:36 -- common/autotest_common.sh@163 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:08:30.210 00:42:36 -- common/autotest_common.sh@166 -- # : 00:08:30.210 00:42:36 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:08:30.210 00:42:36 -- common/autotest_common.sh@168 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:08:30.210 00:42:36 -- common/autotest_common.sh@170 -- # : 0 00:08:30.210 00:42:36 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:30.210 00:42:36 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:30.210 00:42:36 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:30.210 00:42:36 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:08:30.210 00:42:36 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:30.210 00:42:36 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:08:30.210 00:42:36 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:30.210 00:42:36 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:30.210 00:42:36 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:30.210 00:42:36 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:30.210 00:42:36 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:30.210 00:42:36 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:08:30.210 00:42:36 -- common/autotest_common.sh@199 -- # cat 00:08:30.210 00:42:36 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:08:30.210 00:42:36 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:30.210 00:42:36 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:30.210 00:42:36 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:30.210 00:42:36 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:30.210 00:42:36 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:08:30.210 00:42:36 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:08:30.210 00:42:36 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:30.210 00:42:36 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:08:30.210 00:42:36 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:30.210 00:42:36 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:08:30.210 00:42:36 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:30.210 00:42:36 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:30.210 00:42:36 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:30.210 00:42:36 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:30.210 00:42:36 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:30.210 00:42:36 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:30.210 00:42:36 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:08:30.210 00:42:36 -- common/autotest_common.sh@252 -- # export valgrind= 00:08:30.210 00:42:36 -- common/autotest_common.sh@252 -- # valgrind= 00:08:30.210 00:42:36 -- common/autotest_common.sh@258 -- # uname -s 00:08:30.210 00:42:36 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:08:30.210 00:42:36 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:08:30.210 00:42:36 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:08:30.210 00:42:36 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@268 -- # MAKE=make 00:08:30.210 00:42:36 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j112 00:08:30.210 00:42:36 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:08:30.210 00:42:36 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:08:30.210 00:42:36 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:08:30.210 00:42:36 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:08:30.210 00:42:36 -- common/autotest_common.sh@289 -- # for i in "$@" 00:08:30.210 00:42:36 -- common/autotest_common.sh@290 -- # case "$i" in 00:08:30.210 00:42:36 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:08:30.210 00:42:36 -- common/autotest_common.sh@307 -- # [[ -z 163888 ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@307 -- # kill -0 163888 00:08:30.210 00:42:36 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:08:30.210 00:42:36 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:08:30.210 00:42:36 -- common/autotest_common.sh@320 -- # local mount target_dir 00:08:30.210 00:42:36 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:08:30.210 00:42:36 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:08:30.210 00:42:36 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:08:30.210 00:42:36 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:08:30.210 00:42:36 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.U2ljBp 00:08:30.210 00:42:36 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:30.210 00:42:36 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:08:30.210 00:42:36 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.U2ljBp/tests/target /tmp/spdk.U2ljBp 00:08:30.210 00:42:36 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@316 -- # df -T 00:08:30.210 00:42:36 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=958902272 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=4325527552 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=90224275456 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95554736128 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=5330460672 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=47776088064 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777366016 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=1277952 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=19101519872 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19110948864 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=9428992 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=47777062912 00:08:30.210 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777370112 00:08:30.210 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=307200 00:08:30.210 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.210 00:42:36 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:08:30.211 00:42:36 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:08:30.211 00:42:36 -- common/autotest_common.sh@351 -- # avails["$mount"]=9555468288 00:08:30.211 00:42:36 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9555472384 00:08:30.211 00:42:36 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:08:30.211 00:42:36 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:08:30.211 00:42:36 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:08:30.211 * Looking for test storage... 00:08:30.211 00:42:36 -- common/autotest_common.sh@357 -- # local target_space new_size 00:08:30.211 00:42:36 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:08:30.211 00:42:36 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.211 00:42:36 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:30.211 00:42:36 -- common/autotest_common.sh@361 -- # mount=/ 00:08:30.211 00:42:36 -- common/autotest_common.sh@363 -- # target_space=90224275456 00:08:30.211 00:42:36 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:08:30.211 00:42:36 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:08:30.211 00:42:36 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:08:30.211 00:42:36 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:08:30.211 00:42:36 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:08:30.211 00:42:36 -- common/autotest_common.sh@370 -- # new_size=7545053184 00:08:30.211 00:42:36 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:30.211 00:42:36 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.211 00:42:36 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.211 00:42:36 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.211 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:30.211 00:42:36 -- common/autotest_common.sh@378 -- # return 0 00:08:30.211 00:42:36 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:08:30.211 00:42:36 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:08:30.211 00:42:36 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:30.211 00:42:36 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:30.211 00:42:36 -- common/autotest_common.sh@1673 -- # true 00:08:30.211 00:42:36 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:08:30.211 00:42:36 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:30.211 00:42:36 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:30.211 00:42:36 -- common/autotest_common.sh@27 -- # exec 00:08:30.211 00:42:36 -- common/autotest_common.sh@29 -- # exec 00:08:30.211 00:42:36 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:30.211 00:42:36 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:30.211 00:42:36 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:30.211 00:42:36 -- common/autotest_common.sh@18 -- # set -x 00:08:30.211 00:42:36 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:30.211 00:42:36 -- nvmf/common.sh@7 -- # uname -s 00:08:30.211 00:42:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:30.211 00:42:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:30.211 00:42:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:30.211 00:42:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:30.211 00:42:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:30.211 00:42:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:30.211 00:42:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:30.211 00:42:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:30.211 00:42:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:30.211 00:42:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:30.211 00:42:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:30.211 00:42:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:30.211 00:42:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:30.211 00:42:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:30.211 00:42:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:30.211 00:42:36 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:30.211 00:42:36 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:30.211 00:42:36 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:30.211 00:42:36 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:30.211 00:42:36 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:30.211 00:42:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.211 00:42:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.211 00:42:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.211 00:42:36 -- paths/export.sh@5 -- # export PATH 00:08:30.211 00:42:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:30.211 00:42:36 -- nvmf/common.sh@47 -- # : 0 00:08:30.211 00:42:36 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:30.211 00:42:36 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:30.211 00:42:36 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:30.211 00:42:36 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:30.211 00:42:36 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:30.211 00:42:36 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:30.211 00:42:36 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:30.211 00:42:36 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:30.211 00:42:36 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:30.211 00:42:36 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:30.211 00:42:36 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:30.211 00:42:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:30.211 00:42:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:30.211 00:42:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:30.211 00:42:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:30.211 00:42:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:30.211 00:42:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:30.211 00:42:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:30.211 00:42:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:30.211 00:42:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:30.211 00:42:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:30.211 00:42:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:30.211 00:42:36 -- common/autotest_common.sh@10 -- # set +x 00:08:34.401 00:42:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:34.401 00:42:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:34.401 00:42:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:34.401 00:42:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:34.401 00:42:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:34.401 00:42:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:34.401 00:42:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:34.401 00:42:41 -- nvmf/common.sh@295 -- # net_devs=() 00:08:34.401 00:42:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:34.401 00:42:41 -- nvmf/common.sh@296 -- # e810=() 00:08:34.401 00:42:41 -- nvmf/common.sh@296 -- # local -ga e810 00:08:34.401 00:42:41 -- nvmf/common.sh@297 -- # x722=() 00:08:34.401 00:42:41 -- nvmf/common.sh@297 -- # local -ga x722 00:08:34.401 00:42:41 -- nvmf/common.sh@298 -- # mlx=() 00:08:34.401 00:42:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:34.401 00:42:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:34.401 00:42:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:34.401 00:42:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:34.401 00:42:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:34.401 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:34.401 00:42:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:34.401 00:42:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:34.401 00:42:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:34.401 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:34.401 00:42:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:34.401 00:42:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:34.401 00:42:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:34.401 00:42:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.401 00:42:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:34.401 00:42:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.401 00:42:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:34.401 Found net devices under 0000:18:00.0: mlx_0_0 00:08:34.401 00:42:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:34.401 00:42:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:34.401 00:42:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:34.401 00:42:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:34.401 00:42:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:34.401 Found net devices under 0000:18:00.1: mlx_0_1 00:08:34.401 00:42:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:34.401 00:42:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:34.401 00:42:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:34.401 00:42:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:34.401 00:42:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:34.401 00:42:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:34.401 00:42:41 -- nvmf/common.sh@58 -- # uname 00:08:34.401 00:42:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:34.401 00:42:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:34.401 00:42:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:34.401 00:42:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:34.401 00:42:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:34.401 00:42:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:34.401 00:42:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:34.660 00:42:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:34.660 00:42:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:34.660 00:42:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:34.660 00:42:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:34.660 00:42:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:34.660 00:42:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:34.660 00:42:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:34.660 00:42:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:34.660 00:42:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:34.660 00:42:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:34.660 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.660 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:34.660 00:42:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:34.660 00:42:41 -- nvmf/common.sh@105 -- # continue 2 00:08:34.660 00:42:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:34.660 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.660 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:34.660 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.660 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:34.660 00:42:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:34.660 00:42:41 -- nvmf/common.sh@105 -- # continue 2 00:08:34.660 00:42:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:34.660 00:42:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:34.660 00:42:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:34.660 00:42:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:34.660 00:42:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:34.660 00:42:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:34.660 00:42:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:34.661 00:42:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:34.661 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:34.661 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:34.661 altname enp24s0f0np0 00:08:34.661 altname ens785f0np0 00:08:34.661 inet 192.168.100.8/24 scope global mlx_0_0 00:08:34.661 valid_lft forever preferred_lft forever 00:08:34.661 00:42:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:34.661 00:42:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:34.661 00:42:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:34.661 00:42:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:34.661 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:34.661 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:34.661 altname enp24s0f1np1 00:08:34.661 altname ens785f1np1 00:08:34.661 inet 192.168.100.9/24 scope global mlx_0_1 00:08:34.661 valid_lft forever preferred_lft forever 00:08:34.661 00:42:41 -- nvmf/common.sh@411 -- # return 0 00:08:34.661 00:42:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:34.661 00:42:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:34.661 00:42:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:34.661 00:42:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:34.661 00:42:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:34.661 00:42:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:34.661 00:42:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:34.661 00:42:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:34.661 00:42:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:34.661 00:42:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:34.661 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.661 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:34.661 00:42:41 -- nvmf/common.sh@105 -- # continue 2 00:08:34.661 00:42:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:34.661 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.661 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:34.661 00:42:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:34.661 00:42:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@105 -- # continue 2 00:08:34.661 00:42:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:34.661 00:42:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:34.661 00:42:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:34.661 00:42:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:34.661 00:42:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:34.661 00:42:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:34.661 00:42:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:34.661 192.168.100.9' 00:08:34.661 00:42:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:34.661 192.168.100.9' 00:08:34.661 00:42:41 -- nvmf/common.sh@446 -- # head -n 1 00:08:34.661 00:42:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:34.661 00:42:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:34.661 192.168.100.9' 00:08:34.661 00:42:41 -- nvmf/common.sh@447 -- # tail -n +2 00:08:34.661 00:42:41 -- nvmf/common.sh@447 -- # head -n 1 00:08:34.661 00:42:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:34.661 00:42:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:34.661 00:42:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:34.661 00:42:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:34.661 00:42:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:34.661 00:42:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:34.661 00:42:41 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:34.661 00:42:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:34.661 00:42:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.661 00:42:41 -- common/autotest_common.sh@10 -- # set +x 00:08:34.920 ************************************ 00:08:34.920 START TEST nvmf_filesystem_no_in_capsule 00:08:34.920 ************************************ 00:08:34.920 00:42:41 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 0 00:08:34.920 00:42:41 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:34.920 00:42:41 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:34.920 00:42:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:34.920 00:42:41 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:34.920 00:42:41 -- common/autotest_common.sh@10 -- # set +x 00:08:34.920 00:42:41 -- nvmf/common.sh@470 -- # nvmfpid=167054 00:08:34.920 00:42:41 -- nvmf/common.sh@471 -- # waitforlisten 167054 00:08:34.920 00:42:41 -- common/autotest_common.sh@817 -- # '[' -z 167054 ']' 00:08:34.921 00:42:41 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:34.921 00:42:41 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:34.921 00:42:41 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:34.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:34.921 00:42:41 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:34.921 00:42:41 -- common/autotest_common.sh@10 -- # set +x 00:08:34.921 00:42:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:34.921 [2024-04-26 00:42:41.896290] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:34.921 [2024-04-26 00:42:41.896325] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:34.921 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.921 [2024-04-26 00:42:41.946530] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:34.921 [2024-04-26 00:42:42.019957] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:34.921 [2024-04-26 00:42:42.020002] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:34.921 [2024-04-26 00:42:42.020008] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:34.921 [2024-04-26 00:42:42.020014] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:34.921 [2024-04-26 00:42:42.020018] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:34.921 [2024-04-26 00:42:42.020059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:34.921 [2024-04-26 00:42:42.020074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:34.921 [2024-04-26 00:42:42.020159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:34.921 [2024-04-26 00:42:42.020160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:35.488 00:42:42 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:35.488 00:42:42 -- common/autotest_common.sh@850 -- # return 0 00:08:35.488 00:42:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:35.488 00:42:42 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:35.488 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:35.746 00:42:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:35.746 00:42:42 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:35.746 00:42:42 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:35.746 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:35.746 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:35.746 [2024-04-26 00:42:42.717968] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:35.746 [2024-04-26 00:42:42.737496] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x5e6880/0x5ead70) succeed. 00:08:35.746 [2024-04-26 00:42:42.746880] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x5e7ec0/0x62c400) succeed. 00:08:35.746 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:35.746 00:42:42 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:35.746 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:35.746 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:36.004 Malloc1 00:08:36.004 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:36.004 00:42:42 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:36.004 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:36.004 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:36.004 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:36.004 00:42:42 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:36.004 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:36.004 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:36.004 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:36.004 00:42:42 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:36.004 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:36.004 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:36.004 [2024-04-26 00:42:42.976563] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:36.004 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:36.004 00:42:42 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:36.004 00:42:42 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:36.004 00:42:42 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:36.004 00:42:42 -- common/autotest_common.sh@1366 -- # local bs 00:08:36.004 00:42:42 -- common/autotest_common.sh@1367 -- # local nb 00:08:36.004 00:42:42 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:36.004 00:42:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:36.004 00:42:42 -- common/autotest_common.sh@10 -- # set +x 00:08:36.004 00:42:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:36.004 00:42:42 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:36.004 { 00:08:36.004 "name": "Malloc1", 00:08:36.004 "aliases": [ 00:08:36.004 "96214e12-7e24-431b-b34e-e771f0d5afb6" 00:08:36.004 ], 00:08:36.004 "product_name": "Malloc disk", 00:08:36.004 "block_size": 512, 00:08:36.004 "num_blocks": 1048576, 00:08:36.004 "uuid": "96214e12-7e24-431b-b34e-e771f0d5afb6", 00:08:36.004 "assigned_rate_limits": { 00:08:36.004 "rw_ios_per_sec": 0, 00:08:36.004 "rw_mbytes_per_sec": 0, 00:08:36.004 "r_mbytes_per_sec": 0, 00:08:36.004 "w_mbytes_per_sec": 0 00:08:36.004 }, 00:08:36.004 "claimed": true, 00:08:36.004 "claim_type": "exclusive_write", 00:08:36.004 "zoned": false, 00:08:36.004 "supported_io_types": { 00:08:36.004 "read": true, 00:08:36.004 "write": true, 00:08:36.004 "unmap": true, 00:08:36.004 "write_zeroes": true, 00:08:36.004 "flush": true, 00:08:36.004 "reset": true, 00:08:36.004 "compare": false, 00:08:36.004 "compare_and_write": false, 00:08:36.004 "abort": true, 00:08:36.004 "nvme_admin": false, 00:08:36.004 "nvme_io": false 00:08:36.004 }, 00:08:36.004 "memory_domains": [ 00:08:36.004 { 00:08:36.004 "dma_device_id": "system", 00:08:36.004 "dma_device_type": 1 00:08:36.004 }, 00:08:36.004 { 00:08:36.004 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:36.004 "dma_device_type": 2 00:08:36.004 } 00:08:36.004 ], 00:08:36.004 "driver_specific": {} 00:08:36.004 } 00:08:36.004 ]' 00:08:36.004 00:42:42 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:36.004 00:42:43 -- common/autotest_common.sh@1369 -- # bs=512 00:08:36.004 00:42:43 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:36.004 00:42:43 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:36.004 00:42:43 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:36.004 00:42:43 -- common/autotest_common.sh@1374 -- # echo 512 00:08:36.004 00:42:43 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:36.004 00:42:43 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:36.941 00:42:44 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:36.941 00:42:44 -- common/autotest_common.sh@1184 -- # local i=0 00:08:36.941 00:42:44 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:36.941 00:42:44 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:36.941 00:42:44 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:39.476 00:42:46 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:39.476 00:42:46 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:39.476 00:42:46 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:39.476 00:42:46 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:39.476 00:42:46 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:39.476 00:42:46 -- common/autotest_common.sh@1194 -- # return 0 00:08:39.476 00:42:46 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:39.476 00:42:46 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:39.476 00:42:46 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:39.476 00:42:46 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:39.476 00:42:46 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:39.476 00:42:46 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:39.476 00:42:46 -- setup/common.sh@80 -- # echo 536870912 00:08:39.476 00:42:46 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:39.476 00:42:46 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:39.476 00:42:46 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:39.476 00:42:46 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:39.476 00:42:46 -- target/filesystem.sh@69 -- # partprobe 00:08:39.476 00:42:46 -- target/filesystem.sh@70 -- # sleep 1 00:08:40.044 00:42:47 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:40.044 00:42:47 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:40.044 00:42:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.044 00:42:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.044 00:42:47 -- common/autotest_common.sh@10 -- # set +x 00:08:40.302 ************************************ 00:08:40.302 START TEST filesystem_ext4 00:08:40.302 ************************************ 00:08:40.302 00:42:47 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:40.302 00:42:47 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:40.302 00:42:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.302 00:42:47 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:40.302 00:42:47 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:40.302 00:42:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.302 00:42:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.302 00:42:47 -- common/autotest_common.sh@915 -- # local force 00:08:40.302 00:42:47 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:40.302 00:42:47 -- common/autotest_common.sh@918 -- # force=-F 00:08:40.302 00:42:47 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:40.302 mke2fs 1.46.5 (30-Dec-2021) 00:08:40.302 Discarding device blocks: 0/522240 done 00:08:40.302 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:40.302 Filesystem UUID: 0d8ee122-f41f-484b-ba61-5a0a2ae2ad66 00:08:40.302 Superblock backups stored on blocks: 00:08:40.302 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:40.302 00:08:40.302 Allocating group tables: 0/64 done 00:08:40.302 Writing inode tables: 0/64 done 00:08:40.302 Creating journal (8192 blocks): done 00:08:40.302 Writing superblocks and filesystem accounting information: 0/64 done 00:08:40.302 00:08:40.302 00:42:47 -- common/autotest_common.sh@931 -- # return 0 00:08:40.302 00:42:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:40.302 00:42:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:40.302 00:42:47 -- target/filesystem.sh@25 -- # sync 00:08:40.302 00:42:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:40.302 00:42:47 -- target/filesystem.sh@27 -- # sync 00:08:40.561 00:42:47 -- target/filesystem.sh@29 -- # i=0 00:08:40.561 00:42:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:40.561 00:42:47 -- target/filesystem.sh@37 -- # kill -0 167054 00:08:40.561 00:42:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:40.561 00:42:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:40.561 00:42:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:40.561 00:42:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:40.561 00:08:40.561 real 0m0.159s 00:08:40.561 user 0m0.021s 00:08:40.561 sys 0m0.058s 00:08:40.561 00:42:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:40.561 00:42:47 -- common/autotest_common.sh@10 -- # set +x 00:08:40.561 ************************************ 00:08:40.561 END TEST filesystem_ext4 00:08:40.561 ************************************ 00:08:40.561 00:42:47 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:40.561 00:42:47 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.561 00:42:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.561 00:42:47 -- common/autotest_common.sh@10 -- # set +x 00:08:40.561 ************************************ 00:08:40.561 START TEST filesystem_btrfs 00:08:40.561 ************************************ 00:08:40.561 00:42:47 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:40.561 00:42:47 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:40.561 00:42:47 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.561 00:42:47 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:40.562 00:42:47 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:40.562 00:42:47 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.562 00:42:47 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.562 00:42:47 -- common/autotest_common.sh@915 -- # local force 00:08:40.562 00:42:47 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:40.562 00:42:47 -- common/autotest_common.sh@920 -- # force=-f 00:08:40.562 00:42:47 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:40.821 btrfs-progs v6.6.2 00:08:40.821 See https://btrfs.readthedocs.io for more information. 00:08:40.821 00:08:40.821 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:40.821 NOTE: several default settings have changed in version 5.15, please make sure 00:08:40.821 this does not affect your deployments: 00:08:40.821 - DUP for metadata (-m dup) 00:08:40.821 - enabled no-holes (-O no-holes) 00:08:40.821 - enabled free-space-tree (-R free-space-tree) 00:08:40.821 00:08:40.821 Label: (null) 00:08:40.821 UUID: d0e41bc4-b169-4b05-b1a7-a440d65aa80e 00:08:40.821 Node size: 16384 00:08:40.821 Sector size: 4096 00:08:40.821 Filesystem size: 510.00MiB 00:08:40.821 Block group profiles: 00:08:40.821 Data: single 8.00MiB 00:08:40.821 Metadata: DUP 32.00MiB 00:08:40.821 System: DUP 8.00MiB 00:08:40.821 SSD detected: yes 00:08:40.821 Zoned device: no 00:08:40.821 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:40.821 Runtime features: free-space-tree 00:08:40.821 Checksum: crc32c 00:08:40.821 Number of devices: 1 00:08:40.821 Devices: 00:08:40.821 ID SIZE PATH 00:08:40.821 1 510.00MiB /dev/nvme0n1p1 00:08:40.821 00:08:40.821 00:42:47 -- common/autotest_common.sh@931 -- # return 0 00:08:40.821 00:42:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:40.821 00:42:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:40.821 00:42:47 -- target/filesystem.sh@25 -- # sync 00:08:40.821 00:42:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:40.821 00:42:47 -- target/filesystem.sh@27 -- # sync 00:08:40.821 00:42:47 -- target/filesystem.sh@29 -- # i=0 00:08:40.821 00:42:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:40.821 00:42:47 -- target/filesystem.sh@37 -- # kill -0 167054 00:08:40.821 00:42:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:40.821 00:42:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:40.821 00:42:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:40.821 00:42:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:40.821 00:08:40.821 real 0m0.279s 00:08:40.821 user 0m0.025s 00:08:40.821 sys 0m0.158s 00:08:40.821 00:42:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:40.821 00:42:47 -- common/autotest_common.sh@10 -- # set +x 00:08:40.821 ************************************ 00:08:40.821 END TEST filesystem_btrfs 00:08:40.821 ************************************ 00:08:41.081 00:42:48 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:41.081 00:42:48 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:41.081 00:42:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:41.081 00:42:48 -- common/autotest_common.sh@10 -- # set +x 00:08:41.081 ************************************ 00:08:41.081 START TEST filesystem_xfs 00:08:41.081 ************************************ 00:08:41.081 00:42:48 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:41.081 00:42:48 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:41.081 00:42:48 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:41.081 00:42:48 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:41.081 00:42:48 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:41.081 00:42:48 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:41.081 00:42:48 -- common/autotest_common.sh@914 -- # local i=0 00:08:41.081 00:42:48 -- common/autotest_common.sh@915 -- # local force 00:08:41.081 00:42:48 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:41.081 00:42:48 -- common/autotest_common.sh@920 -- # force=-f 00:08:41.081 00:42:48 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:41.081 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:41.081 = sectsz=512 attr=2, projid32bit=1 00:08:41.081 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:41.081 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:41.081 data = bsize=4096 blocks=130560, imaxpct=25 00:08:41.081 = sunit=0 swidth=0 blks 00:08:41.081 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:41.081 log =internal log bsize=4096 blocks=16384, version=2 00:08:41.081 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:41.081 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:41.340 Discarding blocks...Done. 00:08:41.340 00:42:48 -- common/autotest_common.sh@931 -- # return 0 00:08:41.340 00:42:48 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:41.599 00:42:48 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:41.599 00:42:48 -- target/filesystem.sh@25 -- # sync 00:08:41.599 00:42:48 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:41.599 00:42:48 -- target/filesystem.sh@27 -- # sync 00:08:41.599 00:42:48 -- target/filesystem.sh@29 -- # i=0 00:08:41.599 00:42:48 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:41.599 00:42:48 -- target/filesystem.sh@37 -- # kill -0 167054 00:08:41.599 00:42:48 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:41.599 00:42:48 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:41.599 00:42:48 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:41.599 00:42:48 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:41.599 00:08:41.599 real 0m0.614s 00:08:41.599 user 0m0.021s 00:08:41.599 sys 0m0.099s 00:08:41.599 00:42:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:41.599 00:42:48 -- common/autotest_common.sh@10 -- # set +x 00:08:41.599 ************************************ 00:08:41.599 END TEST filesystem_xfs 00:08:41.599 ************************************ 00:08:41.858 00:42:48 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:41.858 00:42:48 -- target/filesystem.sh@93 -- # sync 00:08:41.858 00:42:48 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:42.797 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.797 00:42:49 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:42.797 00:42:49 -- common/autotest_common.sh@1205 -- # local i=0 00:08:42.797 00:42:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:42.797 00:42:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:42.797 00:42:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:42.797 00:42:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:42.797 00:42:49 -- common/autotest_common.sh@1217 -- # return 0 00:08:42.797 00:42:49 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:42.797 00:42:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:42.797 00:42:49 -- common/autotest_common.sh@10 -- # set +x 00:08:42.797 00:42:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:42.797 00:42:49 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:42.797 00:42:49 -- target/filesystem.sh@101 -- # killprocess 167054 00:08:42.797 00:42:49 -- common/autotest_common.sh@936 -- # '[' -z 167054 ']' 00:08:42.797 00:42:49 -- common/autotest_common.sh@940 -- # kill -0 167054 00:08:42.797 00:42:49 -- common/autotest_common.sh@941 -- # uname 00:08:42.797 00:42:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:42.797 00:42:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 167054 00:08:42.797 00:42:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:42.797 00:42:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:42.797 00:42:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 167054' 00:08:42.797 killing process with pid 167054 00:08:42.797 00:42:49 -- common/autotest_common.sh@955 -- # kill 167054 00:08:42.797 00:42:49 -- common/autotest_common.sh@960 -- # wait 167054 00:08:42.797 [2024-04-26 00:42:49.916949] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:43.367 00:42:50 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:43.367 00:08:43.367 real 0m8.413s 00:08:43.367 user 0m32.987s 00:08:43.367 sys 0m1.230s 00:08:43.367 00:42:50 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:43.367 00:42:50 -- common/autotest_common.sh@10 -- # set +x 00:08:43.367 ************************************ 00:08:43.367 END TEST nvmf_filesystem_no_in_capsule 00:08:43.367 ************************************ 00:08:43.367 00:42:50 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:43.367 00:42:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:43.367 00:42:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:43.367 00:42:50 -- common/autotest_common.sh@10 -- # set +x 00:08:43.367 ************************************ 00:08:43.367 START TEST nvmf_filesystem_in_capsule 00:08:43.367 ************************************ 00:08:43.367 00:42:50 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_part 4096 00:08:43.367 00:42:50 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:43.367 00:42:50 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:43.367 00:42:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:43.367 00:42:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:43.367 00:42:50 -- common/autotest_common.sh@10 -- # set +x 00:08:43.367 00:42:50 -- nvmf/common.sh@470 -- # nvmfpid=168823 00:08:43.367 00:42:50 -- nvmf/common.sh@471 -- # waitforlisten 168823 00:08:43.367 00:42:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:43.367 00:42:50 -- common/autotest_common.sh@817 -- # '[' -z 168823 ']' 00:08:43.367 00:42:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:43.367 00:42:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:43.367 00:42:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:43.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:43.367 00:42:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:43.367 00:42:50 -- common/autotest_common.sh@10 -- # set +x 00:08:43.367 [2024-04-26 00:42:50.481489] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:43.367 [2024-04-26 00:42:50.481522] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:43.367 EAL: No free 2048 kB hugepages reported on node 1 00:08:43.367 [2024-04-26 00:42:50.530218] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:43.626 [2024-04-26 00:42:50.606449] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:43.627 [2024-04-26 00:42:50.606481] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:43.627 [2024-04-26 00:42:50.606487] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:43.627 [2024-04-26 00:42:50.606493] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:43.627 [2024-04-26 00:42:50.606498] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:43.627 [2024-04-26 00:42:50.606545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:43.627 [2024-04-26 00:42:50.606596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:43.627 [2024-04-26 00:42:50.606611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:43.627 [2024-04-26 00:42:50.606612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:44.194 00:42:51 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:44.194 00:42:51 -- common/autotest_common.sh@850 -- # return 0 00:08:44.194 00:42:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:44.194 00:42:51 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:44.194 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.194 00:42:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:44.194 00:42:51 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:44.194 00:42:51 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:08:44.194 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.194 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.194 [2024-04-26 00:42:51.328827] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x185e880/0x1862d70) succeed. 00:08:44.194 [2024-04-26 00:42:51.338603] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x185fec0/0x18a4400) succeed. 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.454 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.454 Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:44.454 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.454 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.454 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:44.454 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.454 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.454 [2024-04-26 00:42:51.581746] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@1364 -- # local bdev_name=Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@1365 -- # local bdev_info 00:08:44.454 00:42:51 -- common/autotest_common.sh@1366 -- # local bs 00:08:44.454 00:42:51 -- common/autotest_common.sh@1367 -- # local nb 00:08:44.454 00:42:51 -- common/autotest_common.sh@1368 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:44.454 00:42:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:44.454 00:42:51 -- common/autotest_common.sh@10 -- # set +x 00:08:44.454 00:42:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:44.454 00:42:51 -- common/autotest_common.sh@1368 -- # bdev_info='[ 00:08:44.454 { 00:08:44.454 "name": "Malloc1", 00:08:44.454 "aliases": [ 00:08:44.454 "df45f58b-8f0c-456b-964c-cc41055f4209" 00:08:44.454 ], 00:08:44.454 "product_name": "Malloc disk", 00:08:44.454 "block_size": 512, 00:08:44.454 "num_blocks": 1048576, 00:08:44.454 "uuid": "df45f58b-8f0c-456b-964c-cc41055f4209", 00:08:44.454 "assigned_rate_limits": { 00:08:44.454 "rw_ios_per_sec": 0, 00:08:44.454 "rw_mbytes_per_sec": 0, 00:08:44.454 "r_mbytes_per_sec": 0, 00:08:44.454 "w_mbytes_per_sec": 0 00:08:44.454 }, 00:08:44.454 "claimed": true, 00:08:44.454 "claim_type": "exclusive_write", 00:08:44.454 "zoned": false, 00:08:44.454 "supported_io_types": { 00:08:44.454 "read": true, 00:08:44.454 "write": true, 00:08:44.454 "unmap": true, 00:08:44.454 "write_zeroes": true, 00:08:44.454 "flush": true, 00:08:44.454 "reset": true, 00:08:44.454 "compare": false, 00:08:44.454 "compare_and_write": false, 00:08:44.454 "abort": true, 00:08:44.454 "nvme_admin": false, 00:08:44.454 "nvme_io": false 00:08:44.454 }, 00:08:44.454 "memory_domains": [ 00:08:44.454 { 00:08:44.454 "dma_device_id": "system", 00:08:44.454 "dma_device_type": 1 00:08:44.454 }, 00:08:44.454 { 00:08:44.454 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:44.454 "dma_device_type": 2 00:08:44.454 } 00:08:44.454 ], 00:08:44.454 "driver_specific": {} 00:08:44.454 } 00:08:44.454 ]' 00:08:44.454 00:42:51 -- common/autotest_common.sh@1369 -- # jq '.[] .block_size' 00:08:44.714 00:42:51 -- common/autotest_common.sh@1369 -- # bs=512 00:08:44.714 00:42:51 -- common/autotest_common.sh@1370 -- # jq '.[] .num_blocks' 00:08:44.714 00:42:51 -- common/autotest_common.sh@1370 -- # nb=1048576 00:08:44.714 00:42:51 -- common/autotest_common.sh@1373 -- # bdev_size=512 00:08:44.714 00:42:51 -- common/autotest_common.sh@1374 -- # echo 512 00:08:44.714 00:42:51 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:44.714 00:42:51 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:08:45.655 00:42:52 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:45.655 00:42:52 -- common/autotest_common.sh@1184 -- # local i=0 00:08:45.655 00:42:52 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:08:45.655 00:42:52 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:08:45.655 00:42:52 -- common/autotest_common.sh@1191 -- # sleep 2 00:08:47.559 00:42:54 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:08:47.559 00:42:54 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:08:47.559 00:42:54 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:08:47.559 00:42:54 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:08:47.559 00:42:54 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:08:47.559 00:42:54 -- common/autotest_common.sh@1194 -- # return 0 00:08:47.559 00:42:54 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:47.559 00:42:54 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:47.559 00:42:54 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:47.559 00:42:54 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:47.559 00:42:54 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:47.559 00:42:54 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:47.559 00:42:54 -- setup/common.sh@80 -- # echo 536870912 00:08:47.559 00:42:54 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:47.559 00:42:54 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:47.559 00:42:54 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:47.559 00:42:54 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:47.559 00:42:54 -- target/filesystem.sh@69 -- # partprobe 00:08:47.818 00:42:54 -- target/filesystem.sh@70 -- # sleep 1 00:08:48.755 00:42:55 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:48.755 00:42:55 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:48.755 00:42:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:48.755 00:42:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:48.755 00:42:55 -- common/autotest_common.sh@10 -- # set +x 00:08:48.755 ************************************ 00:08:48.755 START TEST filesystem_in_capsule_ext4 00:08:48.755 ************************************ 00:08:48.755 00:42:55 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:48.755 00:42:55 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:48.755 00:42:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:48.755 00:42:55 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:48.755 00:42:55 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:48.755 00:42:55 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:48.755 00:42:55 -- common/autotest_common.sh@914 -- # local i=0 00:08:48.755 00:42:55 -- common/autotest_common.sh@915 -- # local force 00:08:48.755 00:42:55 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:48.755 00:42:55 -- common/autotest_common.sh@918 -- # force=-F 00:08:48.755 00:42:55 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:48.755 mke2fs 1.46.5 (30-Dec-2021) 00:08:49.014 Discarding device blocks: 0/522240 done 00:08:49.014 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:49.014 Filesystem UUID: e4d1eae6-638e-4c24-9586-a1ae82e992dd 00:08:49.014 Superblock backups stored on blocks: 00:08:49.014 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:49.014 00:08:49.014 Allocating group tables: 0/64 done 00:08:49.014 Writing inode tables: 0/64 done 00:08:49.014 Creating journal (8192 blocks): done 00:08:49.014 Writing superblocks and filesystem accounting information: 0/64 done 00:08:49.014 00:08:49.014 00:42:56 -- common/autotest_common.sh@931 -- # return 0 00:08:49.014 00:42:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:49.014 00:42:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:49.014 00:42:56 -- target/filesystem.sh@25 -- # sync 00:08:49.014 00:42:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:49.014 00:42:56 -- target/filesystem.sh@27 -- # sync 00:08:49.014 00:42:56 -- target/filesystem.sh@29 -- # i=0 00:08:49.014 00:42:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:49.014 00:42:56 -- target/filesystem.sh@37 -- # kill -0 168823 00:08:49.014 00:42:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:49.014 00:42:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:49.014 00:42:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:49.014 00:42:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:49.014 00:08:49.014 real 0m0.158s 00:08:49.014 user 0m0.023s 00:08:49.014 sys 0m0.051s 00:08:49.014 00:42:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:49.014 00:42:56 -- common/autotest_common.sh@10 -- # set +x 00:08:49.014 ************************************ 00:08:49.014 END TEST filesystem_in_capsule_ext4 00:08:49.014 ************************************ 00:08:49.014 00:42:56 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:49.014 00:42:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:49.014 00:42:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:49.014 00:42:56 -- common/autotest_common.sh@10 -- # set +x 00:08:49.273 ************************************ 00:08:49.273 START TEST filesystem_in_capsule_btrfs 00:08:49.273 ************************************ 00:08:49.273 00:42:56 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:49.273 00:42:56 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:49.273 00:42:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:49.273 00:42:56 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:49.273 00:42:56 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:49.273 00:42:56 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:49.273 00:42:56 -- common/autotest_common.sh@914 -- # local i=0 00:08:49.273 00:42:56 -- common/autotest_common.sh@915 -- # local force 00:08:49.273 00:42:56 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:49.273 00:42:56 -- common/autotest_common.sh@920 -- # force=-f 00:08:49.273 00:42:56 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:49.273 btrfs-progs v6.6.2 00:08:49.273 See https://btrfs.readthedocs.io for more information. 00:08:49.273 00:08:49.273 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:49.273 NOTE: several default settings have changed in version 5.15, please make sure 00:08:49.273 this does not affect your deployments: 00:08:49.273 - DUP for metadata (-m dup) 00:08:49.273 - enabled no-holes (-O no-holes) 00:08:49.273 - enabled free-space-tree (-R free-space-tree) 00:08:49.273 00:08:49.273 Label: (null) 00:08:49.273 UUID: 60705462-fcee-4fea-a3d9-5259394f04c8 00:08:49.273 Node size: 16384 00:08:49.273 Sector size: 4096 00:08:49.273 Filesystem size: 510.00MiB 00:08:49.273 Block group profiles: 00:08:49.273 Data: single 8.00MiB 00:08:49.273 Metadata: DUP 32.00MiB 00:08:49.273 System: DUP 8.00MiB 00:08:49.273 SSD detected: yes 00:08:49.273 Zoned device: no 00:08:49.273 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:08:49.273 Runtime features: free-space-tree 00:08:49.273 Checksum: crc32c 00:08:49.273 Number of devices: 1 00:08:49.273 Devices: 00:08:49.273 ID SIZE PATH 00:08:49.273 1 510.00MiB /dev/nvme0n1p1 00:08:49.273 00:08:49.273 00:42:56 -- common/autotest_common.sh@931 -- # return 0 00:08:49.273 00:42:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:49.273 00:42:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:49.273 00:42:56 -- target/filesystem.sh@25 -- # sync 00:08:49.273 00:42:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:49.273 00:42:56 -- target/filesystem.sh@27 -- # sync 00:08:49.273 00:42:56 -- target/filesystem.sh@29 -- # i=0 00:08:49.273 00:42:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:49.532 00:42:56 -- target/filesystem.sh@37 -- # kill -0 168823 00:08:49.532 00:42:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:49.532 00:42:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:49.532 00:42:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:49.532 00:42:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:49.532 00:08:49.532 real 0m0.238s 00:08:49.532 user 0m0.014s 00:08:49.532 sys 0m0.128s 00:08:49.532 00:42:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:49.532 00:42:56 -- common/autotest_common.sh@10 -- # set +x 00:08:49.532 ************************************ 00:08:49.532 END TEST filesystem_in_capsule_btrfs 00:08:49.532 ************************************ 00:08:49.532 00:42:56 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:49.532 00:42:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:49.532 00:42:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:49.532 00:42:56 -- common/autotest_common.sh@10 -- # set +x 00:08:49.532 ************************************ 00:08:49.532 START TEST filesystem_in_capsule_xfs 00:08:49.532 ************************************ 00:08:49.532 00:42:56 -- common/autotest_common.sh@1111 -- # nvmf_filesystem_create xfs nvme0n1 00:08:49.532 00:42:56 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:49.532 00:42:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:49.532 00:42:56 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:49.532 00:42:56 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:49.532 00:42:56 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:49.532 00:42:56 -- common/autotest_common.sh@914 -- # local i=0 00:08:49.532 00:42:56 -- common/autotest_common.sh@915 -- # local force 00:08:49.532 00:42:56 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:49.532 00:42:56 -- common/autotest_common.sh@920 -- # force=-f 00:08:49.532 00:42:56 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:49.792 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:49.792 = sectsz=512 attr=2, projid32bit=1 00:08:49.792 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:49.792 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:49.792 data = bsize=4096 blocks=130560, imaxpct=25 00:08:49.792 = sunit=0 swidth=0 blks 00:08:49.792 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:49.792 log =internal log bsize=4096 blocks=16384, version=2 00:08:49.792 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:49.792 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:49.792 Discarding blocks...Done. 00:08:49.792 00:42:56 -- common/autotest_common.sh@931 -- # return 0 00:08:49.792 00:42:56 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:49.792 00:42:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:49.792 00:42:56 -- target/filesystem.sh@25 -- # sync 00:08:49.792 00:42:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:49.792 00:42:56 -- target/filesystem.sh@27 -- # sync 00:08:49.792 00:42:56 -- target/filesystem.sh@29 -- # i=0 00:08:49.792 00:42:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:49.792 00:42:56 -- target/filesystem.sh@37 -- # kill -0 168823 00:08:49.792 00:42:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:49.792 00:42:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:49.792 00:42:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:49.792 00:42:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:49.792 00:08:49.792 real 0m0.191s 00:08:49.792 user 0m0.029s 00:08:49.792 sys 0m0.056s 00:08:49.792 00:42:56 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:49.792 00:42:56 -- common/autotest_common.sh@10 -- # set +x 00:08:49.792 ************************************ 00:08:49.792 END TEST filesystem_in_capsule_xfs 00:08:49.792 ************************************ 00:08:49.792 00:42:56 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:49.792 00:42:56 -- target/filesystem.sh@93 -- # sync 00:08:49.792 00:42:56 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:50.729 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.729 00:42:57 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:50.729 00:42:57 -- common/autotest_common.sh@1205 -- # local i=0 00:08:50.729 00:42:57 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:08:50.729 00:42:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:50.729 00:42:57 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:08:50.729 00:42:57 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:50.729 00:42:57 -- common/autotest_common.sh@1217 -- # return 0 00:08:50.729 00:42:57 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:50.729 00:42:57 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:50.729 00:42:57 -- common/autotest_common.sh@10 -- # set +x 00:08:50.729 00:42:57 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:50.729 00:42:57 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:50.729 00:42:57 -- target/filesystem.sh@101 -- # killprocess 168823 00:08:50.729 00:42:57 -- common/autotest_common.sh@936 -- # '[' -z 168823 ']' 00:08:50.729 00:42:57 -- common/autotest_common.sh@940 -- # kill -0 168823 00:08:50.729 00:42:57 -- common/autotest_common.sh@941 -- # uname 00:08:50.989 00:42:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:50.989 00:42:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 168823 00:08:50.989 00:42:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:50.989 00:42:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:50.989 00:42:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 168823' 00:08:50.989 killing process with pid 168823 00:08:50.989 00:42:57 -- common/autotest_common.sh@955 -- # kill 168823 00:08:50.989 00:42:57 -- common/autotest_common.sh@960 -- # wait 168823 00:08:50.989 [2024-04-26 00:42:58.041206] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:51.248 00:42:58 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:51.248 00:08:51.248 real 0m7.954s 00:08:51.248 user 0m31.127s 00:08:51.248 sys 0m1.145s 00:08:51.248 00:42:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:51.248 00:42:58 -- common/autotest_common.sh@10 -- # set +x 00:08:51.248 ************************************ 00:08:51.248 END TEST nvmf_filesystem_in_capsule 00:08:51.248 ************************************ 00:08:51.248 00:42:58 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:51.248 00:42:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:51.248 00:42:58 -- nvmf/common.sh@117 -- # sync 00:08:51.248 00:42:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:51.248 00:42:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:51.248 00:42:58 -- nvmf/common.sh@120 -- # set +e 00:08:51.248 00:42:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:51.248 00:42:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:51.248 rmmod nvme_rdma 00:08:51.508 rmmod nvme_fabrics 00:08:51.508 00:42:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:51.508 00:42:58 -- nvmf/common.sh@124 -- # set -e 00:08:51.508 00:42:58 -- nvmf/common.sh@125 -- # return 0 00:08:51.508 00:42:58 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:08:51.508 00:42:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:51.508 00:42:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:51.508 00:08:51.508 real 0m21.791s 00:08:51.508 user 1m5.591s 00:08:51.508 sys 0m6.244s 00:08:51.508 00:42:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:51.508 00:42:58 -- common/autotest_common.sh@10 -- # set +x 00:08:51.508 ************************************ 00:08:51.508 END TEST nvmf_filesystem 00:08:51.508 ************************************ 00:08:51.508 00:42:58 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:51.508 00:42:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:51.508 00:42:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:51.508 00:42:58 -- common/autotest_common.sh@10 -- # set +x 00:08:51.508 ************************************ 00:08:51.508 START TEST nvmf_discovery 00:08:51.508 ************************************ 00:08:51.508 00:42:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:51.767 * Looking for test storage... 00:08:51.767 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:51.767 00:42:58 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:51.767 00:42:58 -- nvmf/common.sh@7 -- # uname -s 00:08:51.767 00:42:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.767 00:42:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.767 00:42:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.767 00:42:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.767 00:42:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.767 00:42:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.767 00:42:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.767 00:42:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.767 00:42:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.767 00:42:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.767 00:42:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:51.767 00:42:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:51.767 00:42:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.767 00:42:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.767 00:42:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:51.767 00:42:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:51.767 00:42:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:51.767 00:42:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.767 00:42:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.767 00:42:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.768 00:42:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.768 00:42:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.768 00:42:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.768 00:42:58 -- paths/export.sh@5 -- # export PATH 00:08:51.768 00:42:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.768 00:42:58 -- nvmf/common.sh@47 -- # : 0 00:08:51.768 00:42:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:51.768 00:42:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:51.768 00:42:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:51.768 00:42:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.768 00:42:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.768 00:42:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:51.768 00:42:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:51.768 00:42:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:51.768 00:42:58 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:51.768 00:42:58 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:51.768 00:42:58 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:51.768 00:42:58 -- target/discovery.sh@15 -- # hash nvme 00:08:51.768 00:42:58 -- target/discovery.sh@20 -- # nvmftestinit 00:08:51.768 00:42:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:51.768 00:42:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:51.768 00:42:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:51.768 00:42:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:51.768 00:42:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:51.768 00:42:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.768 00:42:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.768 00:42:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:51.768 00:42:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:51.768 00:42:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:51.768 00:42:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:51.768 00:42:58 -- common/autotest_common.sh@10 -- # set +x 00:08:57.043 00:43:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:57.043 00:43:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:57.043 00:43:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:57.043 00:43:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:57.043 00:43:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:57.043 00:43:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:57.043 00:43:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:57.043 00:43:03 -- nvmf/common.sh@295 -- # net_devs=() 00:08:57.043 00:43:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:57.043 00:43:03 -- nvmf/common.sh@296 -- # e810=() 00:08:57.043 00:43:03 -- nvmf/common.sh@296 -- # local -ga e810 00:08:57.043 00:43:03 -- nvmf/common.sh@297 -- # x722=() 00:08:57.043 00:43:03 -- nvmf/common.sh@297 -- # local -ga x722 00:08:57.043 00:43:03 -- nvmf/common.sh@298 -- # mlx=() 00:08:57.043 00:43:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:57.043 00:43:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:57.043 00:43:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:57.043 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:57.043 00:43:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.043 00:43:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:57.043 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:57.043 00:43:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:57.043 00:43:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.043 00:43:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.043 00:43:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:57.043 Found net devices under 0000:18:00.0: mlx_0_0 00:08:57.043 00:43:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:57.043 00:43:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:57.043 00:43:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:57.043 Found net devices under 0000:18:00.1: mlx_0_1 00:08:57.043 00:43:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:57.043 00:43:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:57.043 00:43:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:57.043 00:43:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:57.043 00:43:03 -- nvmf/common.sh@58 -- # uname 00:08:57.043 00:43:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:57.043 00:43:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:57.043 00:43:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:57.043 00:43:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:57.043 00:43:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:57.043 00:43:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:57.043 00:43:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:57.043 00:43:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:57.043 00:43:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:57.043 00:43:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:57.043 00:43:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:57.043 00:43:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.043 00:43:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.043 00:43:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.043 00:43:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.043 00:43:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.043 00:43:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.043 00:43:03 -- nvmf/common.sh@105 -- # continue 2 00:08:57.043 00:43:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.043 00:43:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.043 00:43:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.043 00:43:03 -- nvmf/common.sh@105 -- # continue 2 00:08:57.043 00:43:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.043 00:43:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:57.043 00:43:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.043 00:43:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.044 00:43:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.044 00:43:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.044 00:43:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:57.044 00:43:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:57.044 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.044 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:08:57.044 altname enp24s0f0np0 00:08:57.044 altname ens785f0np0 00:08:57.044 inet 192.168.100.8/24 scope global mlx_0_0 00:08:57.044 valid_lft forever preferred_lft forever 00:08:57.044 00:43:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:57.044 00:43:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.044 00:43:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:57.044 00:43:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:57.044 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:57.044 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:08:57.044 altname enp24s0f1np1 00:08:57.044 altname ens785f1np1 00:08:57.044 inet 192.168.100.9/24 scope global mlx_0_1 00:08:57.044 valid_lft forever preferred_lft forever 00:08:57.044 00:43:04 -- nvmf/common.sh@411 -- # return 0 00:08:57.044 00:43:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:57.044 00:43:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:57.044 00:43:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:57.044 00:43:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:57.044 00:43:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:57.044 00:43:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:57.044 00:43:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:57.044 00:43:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:57.044 00:43:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:57.044 00:43:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.044 00:43:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.044 00:43:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:57.044 00:43:04 -- nvmf/common.sh@105 -- # continue 2 00:08:57.044 00:43:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:57.044 00:43:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.044 00:43:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:57.044 00:43:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:57.044 00:43:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@105 -- # continue 2 00:08:57.044 00:43:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.044 00:43:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:57.044 00:43:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.044 00:43:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:57.044 00:43:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:57.044 00:43:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:57.044 00:43:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:57.044 192.168.100.9' 00:08:57.044 00:43:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:57.044 192.168.100.9' 00:08:57.044 00:43:04 -- nvmf/common.sh@446 -- # head -n 1 00:08:57.044 00:43:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:57.044 00:43:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:57.044 192.168.100.9' 00:08:57.044 00:43:04 -- nvmf/common.sh@447 -- # head -n 1 00:08:57.044 00:43:04 -- nvmf/common.sh@447 -- # tail -n +2 00:08:57.044 00:43:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:57.044 00:43:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:57.044 00:43:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:57.044 00:43:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:57.044 00:43:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:57.044 00:43:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:57.044 00:43:04 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:57.044 00:43:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:57.044 00:43:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:08:57.044 00:43:04 -- common/autotest_common.sh@10 -- # set +x 00:08:57.044 00:43:04 -- nvmf/common.sh@470 -- # nvmfpid=173727 00:08:57.044 00:43:04 -- nvmf/common.sh@471 -- # waitforlisten 173727 00:08:57.044 00:43:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:57.044 00:43:04 -- common/autotest_common.sh@817 -- # '[' -z 173727 ']' 00:08:57.044 00:43:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:57.044 00:43:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:08:57.044 00:43:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:57.044 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:57.044 00:43:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:08:57.044 00:43:04 -- common/autotest_common.sh@10 -- # set +x 00:08:57.044 [2024-04-26 00:43:04.158721] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:08:57.044 [2024-04-26 00:43:04.158765] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:57.044 EAL: No free 2048 kB hugepages reported on node 1 00:08:57.044 [2024-04-26 00:43:04.210322] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:57.304 [2024-04-26 00:43:04.282712] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:57.304 [2024-04-26 00:43:04.282748] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:57.304 [2024-04-26 00:43:04.282754] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:57.304 [2024-04-26 00:43:04.282759] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:57.304 [2024-04-26 00:43:04.282764] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:57.304 [2024-04-26 00:43:04.285257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:57.304 [2024-04-26 00:43:04.285286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:57.304 [2024-04-26 00:43:04.285369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:57.304 [2024-04-26 00:43:04.285387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.873 00:43:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:08:57.873 00:43:04 -- common/autotest_common.sh@850 -- # return 0 00:08:57.873 00:43:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:57.873 00:43:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:08:57.873 00:43:04 -- common/autotest_common.sh@10 -- # set +x 00:08:57.873 00:43:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:57.873 00:43:04 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:57.873 00:43:04 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:57.873 00:43:04 -- common/autotest_common.sh@10 -- # set +x 00:08:57.873 [2024-04-26 00:43:05.000405] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc14880/0xc18d70) succeed. 00:08:57.873 [2024-04-26 00:43:05.009557] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc15ec0/0xc5a400) succeed. 00:08:58.133 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.133 00:43:05 -- target/discovery.sh@26 -- # seq 1 4 00:08:58.133 00:43:05 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:58.133 00:43:05 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:58.133 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.133 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.133 Null1 00:08:58.133 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.133 00:43:05 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:58.133 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.133 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.133 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.133 00:43:05 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:58.133 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.133 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.133 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.133 00:43:05 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:58.133 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.133 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.133 [2024-04-26 00:43:05.162328] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:58.134 00:43:05 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 Null2 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:58.134 00:43:05 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 Null3 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:58.134 00:43:05 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 Null4 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:08:58.134 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.134 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.134 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.134 00:43:05 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:08:58.394 00:08:58.394 Discovery Log Number of Records 6, Generation counter 6 00:08:58.394 =====Discovery Log Entry 0====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: current discovery subsystem 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4420 00:08:58.394 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: explicit discovery connections, duplicate discovery information 00:08:58.394 rdma_prtype: not specified 00:08:58.394 rdma_qptype: connected 00:08:58.394 rdma_cms: rdma-cm 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 =====Discovery Log Entry 1====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: nvme subsystem 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4420 00:08:58.394 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: none 00:08:58.394 rdma_prtype: not specified 00:08:58.394 rdma_qptype: connected 00:08:58.394 rdma_cms: rdma-cm 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 =====Discovery Log Entry 2====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: nvme subsystem 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4420 00:08:58.394 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: none 00:08:58.394 rdma_prtype: not specified 00:08:58.394 rdma_qptype: connected 00:08:58.394 rdma_cms: rdma-cm 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 =====Discovery Log Entry 3====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: nvme subsystem 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4420 00:08:58.394 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: none 00:08:58.394 rdma_prtype: not specified 00:08:58.394 rdma_qptype: connected 00:08:58.394 rdma_cms: rdma-cm 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 =====Discovery Log Entry 4====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: nvme subsystem 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4420 00:08:58.394 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: none 00:08:58.394 rdma_prtype: not specified 00:08:58.394 rdma_qptype: connected 00:08:58.394 rdma_cms: rdma-cm 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 =====Discovery Log Entry 5====== 00:08:58.394 trtype: rdma 00:08:58.394 adrfam: ipv4 00:08:58.394 subtype: discovery subsystem referral 00:08:58.394 treq: not required 00:08:58.394 portid: 0 00:08:58.394 trsvcid: 4430 00:08:58.394 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:58.394 traddr: 192.168.100.8 00:08:58.394 eflags: none 00:08:58.394 rdma_prtype: unrecognized 00:08:58.394 rdma_qptype: unrecognized 00:08:58.394 rdma_cms: unrecognized 00:08:58.394 rdma_pkey: 0x0000 00:08:58.394 00:43:05 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:58.394 Perform nvmf subsystem discovery via RPC 00:08:58.394 00:43:05 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:58.394 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.394 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.394 [2024-04-26 00:43:05.370754] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:58.394 [ 00:08:58.394 { 00:08:58.394 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:58.394 "subtype": "Discovery", 00:08:58.394 "listen_addresses": [ 00:08:58.394 { 00:08:58.394 "transport": "RDMA", 00:08:58.394 "trtype": "RDMA", 00:08:58.394 "adrfam": "IPv4", 00:08:58.394 "traddr": "192.168.100.8", 00:08:58.394 "trsvcid": "4420" 00:08:58.394 } 00:08:58.394 ], 00:08:58.394 "allow_any_host": true, 00:08:58.394 "hosts": [] 00:08:58.394 }, 00:08:58.394 { 00:08:58.394 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:58.394 "subtype": "NVMe", 00:08:58.394 "listen_addresses": [ 00:08:58.394 { 00:08:58.394 "transport": "RDMA", 00:08:58.394 "trtype": "RDMA", 00:08:58.394 "adrfam": "IPv4", 00:08:58.394 "traddr": "192.168.100.8", 00:08:58.394 "trsvcid": "4420" 00:08:58.394 } 00:08:58.394 ], 00:08:58.394 "allow_any_host": true, 00:08:58.394 "hosts": [], 00:08:58.394 "serial_number": "SPDK00000000000001", 00:08:58.394 "model_number": "SPDK bdev Controller", 00:08:58.394 "max_namespaces": 32, 00:08:58.394 "min_cntlid": 1, 00:08:58.394 "max_cntlid": 65519, 00:08:58.394 "namespaces": [ 00:08:58.394 { 00:08:58.394 "nsid": 1, 00:08:58.394 "bdev_name": "Null1", 00:08:58.394 "name": "Null1", 00:08:58.394 "nguid": "26F61AF1A2AC40CEB13EA8F28B47E710", 00:08:58.394 "uuid": "26f61af1-a2ac-40ce-b13e-a8f28b47e710" 00:08:58.394 } 00:08:58.394 ] 00:08:58.394 }, 00:08:58.394 { 00:08:58.394 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:58.394 "subtype": "NVMe", 00:08:58.394 "listen_addresses": [ 00:08:58.394 { 00:08:58.394 "transport": "RDMA", 00:08:58.394 "trtype": "RDMA", 00:08:58.394 "adrfam": "IPv4", 00:08:58.394 "traddr": "192.168.100.8", 00:08:58.394 "trsvcid": "4420" 00:08:58.394 } 00:08:58.394 ], 00:08:58.394 "allow_any_host": true, 00:08:58.394 "hosts": [], 00:08:58.394 "serial_number": "SPDK00000000000002", 00:08:58.394 "model_number": "SPDK bdev Controller", 00:08:58.394 "max_namespaces": 32, 00:08:58.394 "min_cntlid": 1, 00:08:58.394 "max_cntlid": 65519, 00:08:58.394 "namespaces": [ 00:08:58.394 { 00:08:58.394 "nsid": 1, 00:08:58.394 "bdev_name": "Null2", 00:08:58.394 "name": "Null2", 00:08:58.394 "nguid": "DE9664F746EE4E7EA747278A0C4CA022", 00:08:58.394 "uuid": "de9664f7-46ee-4e7e-a747-278a0c4ca022" 00:08:58.394 } 00:08:58.394 ] 00:08:58.394 }, 00:08:58.394 { 00:08:58.394 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:58.394 "subtype": "NVMe", 00:08:58.394 "listen_addresses": [ 00:08:58.394 { 00:08:58.394 "transport": "RDMA", 00:08:58.394 "trtype": "RDMA", 00:08:58.394 "adrfam": "IPv4", 00:08:58.394 "traddr": "192.168.100.8", 00:08:58.394 "trsvcid": "4420" 00:08:58.394 } 00:08:58.394 ], 00:08:58.394 "allow_any_host": true, 00:08:58.394 "hosts": [], 00:08:58.394 "serial_number": "SPDK00000000000003", 00:08:58.394 "model_number": "SPDK bdev Controller", 00:08:58.394 "max_namespaces": 32, 00:08:58.394 "min_cntlid": 1, 00:08:58.394 "max_cntlid": 65519, 00:08:58.394 "namespaces": [ 00:08:58.394 { 00:08:58.394 "nsid": 1, 00:08:58.394 "bdev_name": "Null3", 00:08:58.394 "name": "Null3", 00:08:58.395 "nguid": "A16F58D17E5B4753B9B91E2F1B725E6E", 00:08:58.395 "uuid": "a16f58d1-7e5b-4753-b9b9-1e2f1b725e6e" 00:08:58.395 } 00:08:58.395 ] 00:08:58.395 }, 00:08:58.395 { 00:08:58.395 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:58.395 "subtype": "NVMe", 00:08:58.395 "listen_addresses": [ 00:08:58.395 { 00:08:58.395 "transport": "RDMA", 00:08:58.395 "trtype": "RDMA", 00:08:58.395 "adrfam": "IPv4", 00:08:58.395 "traddr": "192.168.100.8", 00:08:58.395 "trsvcid": "4420" 00:08:58.395 } 00:08:58.395 ], 00:08:58.395 "allow_any_host": true, 00:08:58.395 "hosts": [], 00:08:58.395 "serial_number": "SPDK00000000000004", 00:08:58.395 "model_number": "SPDK bdev Controller", 00:08:58.395 "max_namespaces": 32, 00:08:58.395 "min_cntlid": 1, 00:08:58.395 "max_cntlid": 65519, 00:08:58.395 "namespaces": [ 00:08:58.395 { 00:08:58.395 "nsid": 1, 00:08:58.395 "bdev_name": "Null4", 00:08:58.395 "name": "Null4", 00:08:58.395 "nguid": "E688D38E3F0149DABF9996FC0AAACF6B", 00:08:58.395 "uuid": "e688d38e-3f01-49da-bf99-96fc0aaacf6b" 00:08:58.395 } 00:08:58.395 ] 00:08:58.395 } 00:08:58.395 ] 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@42 -- # seq 1 4 00:08:58.395 00:43:05 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:58.395 00:43:05 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:58.395 00:43:05 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:58.395 00:43:05 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:58.395 00:43:05 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:58.395 00:43:05 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:58.395 00:43:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:08:58.395 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.395 00:43:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:08:58.395 00:43:05 -- target/discovery.sh@49 -- # check_bdevs= 00:08:58.395 00:43:05 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:58.395 00:43:05 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:58.395 00:43:05 -- target/discovery.sh@57 -- # nvmftestfini 00:08:58.395 00:43:05 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:58.395 00:43:05 -- nvmf/common.sh@117 -- # sync 00:08:58.395 00:43:05 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:58.395 00:43:05 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:58.395 00:43:05 -- nvmf/common.sh@120 -- # set +e 00:08:58.395 00:43:05 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:58.395 00:43:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:58.395 rmmod nvme_rdma 00:08:58.395 rmmod nvme_fabrics 00:08:58.395 00:43:05 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:58.395 00:43:05 -- nvmf/common.sh@124 -- # set -e 00:08:58.395 00:43:05 -- nvmf/common.sh@125 -- # return 0 00:08:58.395 00:43:05 -- nvmf/common.sh@478 -- # '[' -n 173727 ']' 00:08:58.395 00:43:05 -- nvmf/common.sh@479 -- # killprocess 173727 00:08:58.395 00:43:05 -- common/autotest_common.sh@936 -- # '[' -z 173727 ']' 00:08:58.395 00:43:05 -- common/autotest_common.sh@940 -- # kill -0 173727 00:08:58.395 00:43:05 -- common/autotest_common.sh@941 -- # uname 00:08:58.395 00:43:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:58.395 00:43:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 173727 00:08:58.654 00:43:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:58.654 00:43:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:58.655 00:43:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 173727' 00:08:58.655 killing process with pid 173727 00:08:58.655 00:43:05 -- common/autotest_common.sh@955 -- # kill 173727 00:08:58.655 [2024-04-26 00:43:05.602090] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:58.655 00:43:05 -- common/autotest_common.sh@960 -- # wait 173727 00:08:58.655 [2024-04-26 00:43:05.676910] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:58.914 00:43:05 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:58.914 00:43:05 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:58.914 00:08:58.914 real 0m7.216s 00:08:58.914 user 0m7.845s 00:08:58.914 sys 0m4.351s 00:08:58.914 00:43:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:08:58.914 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.914 ************************************ 00:08:58.914 END TEST nvmf_discovery 00:08:58.914 ************************************ 00:08:58.914 00:43:05 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:58.914 00:43:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:58.914 00:43:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:58.914 00:43:05 -- common/autotest_common.sh@10 -- # set +x 00:08:58.914 ************************************ 00:08:58.914 START TEST nvmf_referrals 00:08:58.914 ************************************ 00:08:58.914 00:43:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:58.914 * Looking for test storage... 00:08:58.914 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:58.914 00:43:06 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:58.914 00:43:06 -- nvmf/common.sh@7 -- # uname -s 00:08:58.914 00:43:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:58.914 00:43:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:58.914 00:43:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:58.914 00:43:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:59.175 00:43:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:59.175 00:43:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:59.175 00:43:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:59.175 00:43:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:59.175 00:43:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:59.175 00:43:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:59.175 00:43:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:08:59.175 00:43:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:08:59.175 00:43:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:59.175 00:43:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:59.175 00:43:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:59.175 00:43:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:59.175 00:43:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:59.175 00:43:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:59.175 00:43:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:59.175 00:43:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:59.175 00:43:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.175 00:43:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.175 00:43:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.175 00:43:06 -- paths/export.sh@5 -- # export PATH 00:08:59.175 00:43:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.175 00:43:06 -- nvmf/common.sh@47 -- # : 0 00:08:59.175 00:43:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:59.175 00:43:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:59.175 00:43:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:59.175 00:43:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:59.175 00:43:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:59.175 00:43:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:59.175 00:43:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:59.175 00:43:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:59.175 00:43:06 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:59.175 00:43:06 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:59.175 00:43:06 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:59.175 00:43:06 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:59.175 00:43:06 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:59.175 00:43:06 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:59.175 00:43:06 -- target/referrals.sh@37 -- # nvmftestinit 00:08:59.175 00:43:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:59.175 00:43:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:59.175 00:43:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:59.175 00:43:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:59.175 00:43:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:59.175 00:43:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.175 00:43:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.175 00:43:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.175 00:43:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:59.175 00:43:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:59.175 00:43:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:59.175 00:43:06 -- common/autotest_common.sh@10 -- # set +x 00:09:04.453 00:43:11 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:04.453 00:43:11 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:04.453 00:43:11 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:04.453 00:43:11 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:04.453 00:43:11 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:04.453 00:43:11 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:04.453 00:43:11 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:04.453 00:43:11 -- nvmf/common.sh@295 -- # net_devs=() 00:09:04.453 00:43:11 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:04.453 00:43:11 -- nvmf/common.sh@296 -- # e810=() 00:09:04.453 00:43:11 -- nvmf/common.sh@296 -- # local -ga e810 00:09:04.453 00:43:11 -- nvmf/common.sh@297 -- # x722=() 00:09:04.453 00:43:11 -- nvmf/common.sh@297 -- # local -ga x722 00:09:04.453 00:43:11 -- nvmf/common.sh@298 -- # mlx=() 00:09:04.453 00:43:11 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:04.453 00:43:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:04.453 00:43:11 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:04.453 00:43:11 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:04.453 00:43:11 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:04.453 00:43:11 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:04.453 00:43:11 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:04.453 00:43:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:04.453 00:43:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:04.453 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:04.453 00:43:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:04.453 00:43:11 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:04.453 00:43:11 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:04.453 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:04.453 00:43:11 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:04.453 00:43:11 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:04.454 00:43:11 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:04.454 00:43:11 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:04.454 00:43:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:04.454 00:43:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.454 00:43:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:04.454 00:43:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.454 00:43:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:04.454 Found net devices under 0000:18:00.0: mlx_0_0 00:09:04.454 00:43:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.454 00:43:11 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:04.713 00:43:11 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.713 00:43:11 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:04.713 00:43:11 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.713 00:43:11 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:04.713 Found net devices under 0000:18:00.1: mlx_0_1 00:09:04.713 00:43:11 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.713 00:43:11 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:04.713 00:43:11 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:04.713 00:43:11 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:04.713 00:43:11 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:04.713 00:43:11 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:04.713 00:43:11 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:04.713 00:43:11 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:04.713 00:43:11 -- nvmf/common.sh@58 -- # uname 00:09:04.713 00:43:11 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:04.713 00:43:11 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:04.713 00:43:11 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:04.713 00:43:11 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:04.713 00:43:11 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:04.713 00:43:11 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:04.713 00:43:11 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:04.713 00:43:11 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:04.713 00:43:11 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:04.713 00:43:11 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:04.714 00:43:11 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:04.714 00:43:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:04.714 00:43:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:04.714 00:43:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:04.714 00:43:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:04.714 00:43:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:04.714 00:43:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@105 -- # continue 2 00:09:04.714 00:43:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@105 -- # continue 2 00:09:04.714 00:43:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:04.714 00:43:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:04.714 00:43:11 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:04.714 00:43:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:04.714 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:04.714 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:09:04.714 altname enp24s0f0np0 00:09:04.714 altname ens785f0np0 00:09:04.714 inet 192.168.100.8/24 scope global mlx_0_0 00:09:04.714 valid_lft forever preferred_lft forever 00:09:04.714 00:43:11 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:04.714 00:43:11 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:04.714 00:43:11 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:04.714 00:43:11 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:04.714 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:04.714 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:09:04.714 altname enp24s0f1np1 00:09:04.714 altname ens785f1np1 00:09:04.714 inet 192.168.100.9/24 scope global mlx_0_1 00:09:04.714 valid_lft forever preferred_lft forever 00:09:04.714 00:43:11 -- nvmf/common.sh@411 -- # return 0 00:09:04.714 00:43:11 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:04.714 00:43:11 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:04.714 00:43:11 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:04.714 00:43:11 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:04.714 00:43:11 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:04.714 00:43:11 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:04.714 00:43:11 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:04.714 00:43:11 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:04.714 00:43:11 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:04.714 00:43:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@105 -- # continue 2 00:09:04.714 00:43:11 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:04.714 00:43:11 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:04.714 00:43:11 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@105 -- # continue 2 00:09:04.714 00:43:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:04.714 00:43:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:04.714 00:43:11 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:04.714 00:43:11 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:04.714 00:43:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:04.714 00:43:11 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:04.714 192.168.100.9' 00:09:04.714 00:43:11 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:04.714 192.168.100.9' 00:09:04.714 00:43:11 -- nvmf/common.sh@446 -- # head -n 1 00:09:04.714 00:43:11 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:04.714 00:43:11 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:04.714 192.168.100.9' 00:09:04.714 00:43:11 -- nvmf/common.sh@447 -- # tail -n +2 00:09:04.714 00:43:11 -- nvmf/common.sh@447 -- # head -n 1 00:09:04.714 00:43:11 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:04.714 00:43:11 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:04.714 00:43:11 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:04.714 00:43:11 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:04.714 00:43:11 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:04.714 00:43:11 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:04.714 00:43:11 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:04.714 00:43:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:04.714 00:43:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:04.714 00:43:11 -- common/autotest_common.sh@10 -- # set +x 00:09:04.714 00:43:11 -- nvmf/common.sh@470 -- # nvmfpid=177291 00:09:04.714 00:43:11 -- nvmf/common.sh@471 -- # waitforlisten 177291 00:09:04.714 00:43:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:04.714 00:43:11 -- common/autotest_common.sh@817 -- # '[' -z 177291 ']' 00:09:04.714 00:43:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:04.714 00:43:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:04.714 00:43:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:04.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:04.714 00:43:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:04.714 00:43:11 -- common/autotest_common.sh@10 -- # set +x 00:09:04.714 [2024-04-26 00:43:11.893396] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:09:04.714 [2024-04-26 00:43:11.893444] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:04.973 EAL: No free 2048 kB hugepages reported on node 1 00:09:04.973 [2024-04-26 00:43:11.946281] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:04.973 [2024-04-26 00:43:12.014111] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:04.973 [2024-04-26 00:43:12.014150] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:04.973 [2024-04-26 00:43:12.014157] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:04.973 [2024-04-26 00:43:12.014162] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:04.973 [2024-04-26 00:43:12.014166] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:04.973 [2024-04-26 00:43:12.014220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:04.973 [2024-04-26 00:43:12.014317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:04.973 [2024-04-26 00:43:12.014339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:04.973 [2024-04-26 00:43:12.014340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:05.540 00:43:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:05.540 00:43:12 -- common/autotest_common.sh@850 -- # return 0 00:09:05.540 00:43:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:05.540 00:43:12 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:05.540 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.540 00:43:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:05.540 00:43:12 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:05.540 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.540 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 [2024-04-26 00:43:12.735635] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xfb8880/0xfbcd70) succeed. 00:09:05.798 [2024-04-26 00:43:12.744901] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xfb9ec0/0xffe400) succeed. 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 [2024-04-26 00:43:12.859664] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:05.798 00:43:12 -- target/referrals.sh@48 -- # jq length 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:05.798 00:43:12 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:05.798 00:43:12 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:05.798 00:43:12 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:05.798 00:43:12 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:05.798 00:43:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:05.798 00:43:12 -- target/referrals.sh@21 -- # sort 00:09:05.798 00:43:12 -- common/autotest_common.sh@10 -- # set +x 00:09:05.798 00:43:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:05.798 00:43:12 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:05.798 00:43:12 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:05.798 00:43:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:05.798 00:43:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:05.798 00:43:12 -- target/referrals.sh@26 -- # sort 00:09:05.798 00:43:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:05.798 00:43:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:06.056 00:43:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:06.056 00:43:13 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:06.056 00:43:13 -- target/referrals.sh@56 -- # jq length 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:06.056 00:43:13 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:06.056 00:43:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:06.056 00:43:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:06.056 00:43:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:06.056 00:43:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.056 00:43:13 -- target/referrals.sh@26 -- # sort 00:09:06.056 00:43:13 -- target/referrals.sh@26 -- # echo 00:09:06.056 00:43:13 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:06.056 00:43:13 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.056 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.056 00:43:13 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:06.056 00:43:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:06.056 00:43:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:06.056 00:43:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:06.056 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.056 00:43:13 -- target/referrals.sh@21 -- # sort 00:09:06.056 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.315 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.315 00:43:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:06.315 00:43:13 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:06.315 00:43:13 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:06.315 00:43:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:06.315 00:43:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:06.315 00:43:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.315 00:43:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:06.315 00:43:13 -- target/referrals.sh@26 -- # sort 00:09:06.315 00:43:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:06.315 00:43:13 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:06.315 00:43:13 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:06.315 00:43:13 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:06.315 00:43:13 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:06.315 00:43:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.315 00:43:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:06.315 00:43:13 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:06.315 00:43:13 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:06.315 00:43:13 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:06.315 00:43:13 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:06.315 00:43:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.315 00:43:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:06.573 00:43:13 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:06.573 00:43:13 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:06.573 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.573 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.573 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.573 00:43:13 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:06.574 00:43:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:06.574 00:43:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:06.574 00:43:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:06.574 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.574 00:43:13 -- target/referrals.sh@21 -- # sort 00:09:06.574 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.574 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.574 00:43:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:06.574 00:43:13 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:06.574 00:43:13 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:06.574 00:43:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:06.574 00:43:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:06.574 00:43:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.574 00:43:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:06.574 00:43:13 -- target/referrals.sh@26 -- # sort 00:09:06.574 00:43:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:06.574 00:43:13 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:06.574 00:43:13 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:06.574 00:43:13 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:06.574 00:43:13 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:06.574 00:43:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.574 00:43:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:06.832 00:43:13 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:06.832 00:43:13 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:06.832 00:43:13 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:06.832 00:43:13 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:06.832 00:43:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:06.832 00:43:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.832 00:43:13 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:06.832 00:43:13 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:06.832 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.832 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.832 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.832 00:43:13 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:06.832 00:43:13 -- target/referrals.sh@82 -- # jq length 00:09:06.832 00:43:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:06.832 00:43:13 -- common/autotest_common.sh@10 -- # set +x 00:09:06.832 00:43:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:06.832 00:43:13 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:06.832 00:43:13 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:06.832 00:43:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:06.832 00:43:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:06.832 00:43:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:09:06.832 00:43:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:06.832 00:43:13 -- target/referrals.sh@26 -- # sort 00:09:07.091 00:43:14 -- target/referrals.sh@26 -- # echo 00:09:07.091 00:43:14 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:07.091 00:43:14 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:07.091 00:43:14 -- target/referrals.sh@86 -- # nvmftestfini 00:09:07.091 00:43:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:07.091 00:43:14 -- nvmf/common.sh@117 -- # sync 00:09:07.091 00:43:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:07.091 00:43:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:07.091 00:43:14 -- nvmf/common.sh@120 -- # set +e 00:09:07.091 00:43:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:07.091 00:43:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:07.091 rmmod nvme_rdma 00:09:07.091 rmmod nvme_fabrics 00:09:07.091 00:43:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:07.091 00:43:14 -- nvmf/common.sh@124 -- # set -e 00:09:07.091 00:43:14 -- nvmf/common.sh@125 -- # return 0 00:09:07.091 00:43:14 -- nvmf/common.sh@478 -- # '[' -n 177291 ']' 00:09:07.091 00:43:14 -- nvmf/common.sh@479 -- # killprocess 177291 00:09:07.091 00:43:14 -- common/autotest_common.sh@936 -- # '[' -z 177291 ']' 00:09:07.091 00:43:14 -- common/autotest_common.sh@940 -- # kill -0 177291 00:09:07.091 00:43:14 -- common/autotest_common.sh@941 -- # uname 00:09:07.091 00:43:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:07.091 00:43:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 177291 00:09:07.091 00:43:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:07.091 00:43:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:07.091 00:43:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 177291' 00:09:07.091 killing process with pid 177291 00:09:07.091 00:43:14 -- common/autotest_common.sh@955 -- # kill 177291 00:09:07.091 00:43:14 -- common/autotest_common.sh@960 -- # wait 177291 00:09:07.091 [2024-04-26 00:43:14.198671] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:07.350 00:43:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:07.350 00:43:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:07.350 00:09:07.350 real 0m8.371s 00:09:07.350 user 0m11.710s 00:09:07.350 sys 0m4.973s 00:09:07.350 00:43:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:09:07.350 00:43:14 -- common/autotest_common.sh@10 -- # set +x 00:09:07.350 ************************************ 00:09:07.350 END TEST nvmf_referrals 00:09:07.350 ************************************ 00:09:07.350 00:43:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:07.350 00:43:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:07.350 00:43:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:07.350 00:43:14 -- common/autotest_common.sh@10 -- # set +x 00:09:07.610 ************************************ 00:09:07.610 START TEST nvmf_connect_disconnect 00:09:07.610 ************************************ 00:09:07.610 00:43:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:09:07.610 * Looking for test storage... 00:09:07.610 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:07.610 00:43:14 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:07.610 00:43:14 -- nvmf/common.sh@7 -- # uname -s 00:09:07.610 00:43:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:07.610 00:43:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:07.610 00:43:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:07.610 00:43:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:07.610 00:43:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:07.610 00:43:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:07.610 00:43:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:07.610 00:43:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:07.610 00:43:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:07.610 00:43:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:07.610 00:43:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:09:07.610 00:43:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:09:07.610 00:43:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:07.610 00:43:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:07.610 00:43:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:07.610 00:43:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:07.610 00:43:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:07.610 00:43:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:07.610 00:43:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:07.610 00:43:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:07.610 00:43:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.610 00:43:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.610 00:43:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.611 00:43:14 -- paths/export.sh@5 -- # export PATH 00:09:07.611 00:43:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.611 00:43:14 -- nvmf/common.sh@47 -- # : 0 00:09:07.611 00:43:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:07.611 00:43:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:07.611 00:43:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:07.611 00:43:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:07.611 00:43:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:07.611 00:43:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:07.611 00:43:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:07.611 00:43:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:07.611 00:43:14 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:07.611 00:43:14 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:07.611 00:43:14 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:07.611 00:43:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:07.611 00:43:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:07.611 00:43:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:07.611 00:43:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:07.611 00:43:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:07.611 00:43:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:07.611 00:43:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:07.611 00:43:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:07.611 00:43:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:07.611 00:43:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:07.611 00:43:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:07.611 00:43:14 -- common/autotest_common.sh@10 -- # set +x 00:09:12.884 00:43:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:12.884 00:43:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:12.884 00:43:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:12.884 00:43:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:12.884 00:43:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:12.884 00:43:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:12.884 00:43:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:12.884 00:43:19 -- nvmf/common.sh@295 -- # net_devs=() 00:09:12.884 00:43:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:12.884 00:43:19 -- nvmf/common.sh@296 -- # e810=() 00:09:12.884 00:43:19 -- nvmf/common.sh@296 -- # local -ga e810 00:09:12.884 00:43:19 -- nvmf/common.sh@297 -- # x722=() 00:09:12.884 00:43:19 -- nvmf/common.sh@297 -- # local -ga x722 00:09:12.884 00:43:19 -- nvmf/common.sh@298 -- # mlx=() 00:09:12.884 00:43:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:12.884 00:43:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:12.884 00:43:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:12.884 00:43:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:12.884 00:43:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:12.884 00:43:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:12.884 00:43:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:12.884 00:43:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:12.884 00:43:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:12.884 00:43:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:12.885 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:12.885 00:43:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:12.885 00:43:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:12.885 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:12.885 00:43:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:12.885 00:43:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:12.885 00:43:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:12.885 00:43:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:12.885 Found net devices under 0000:18:00.0: mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:12.885 00:43:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:12.885 00:43:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:12.885 00:43:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:12.885 Found net devices under 0000:18:00.1: mlx_0_1 00:09:12.885 00:43:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:12.885 00:43:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:12.885 00:43:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:12.885 00:43:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:12.885 00:43:19 -- nvmf/common.sh@58 -- # uname 00:09:12.885 00:43:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:12.885 00:43:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:12.885 00:43:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:12.885 00:43:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:12.885 00:43:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:12.885 00:43:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:12.885 00:43:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:12.885 00:43:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:12.885 00:43:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:12.885 00:43:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:12.885 00:43:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:12.885 00:43:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:12.885 00:43:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:12.885 00:43:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:12.885 00:43:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:12.885 00:43:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@105 -- # continue 2 00:09:12.885 00:43:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:12.885 00:43:19 -- nvmf/common.sh@105 -- # continue 2 00:09:12.885 00:43:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:12.885 00:43:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:12.885 00:43:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:12.885 00:43:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:12.885 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:12.885 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:09:12.885 altname enp24s0f0np0 00:09:12.885 altname ens785f0np0 00:09:12.885 inet 192.168.100.8/24 scope global mlx_0_0 00:09:12.885 valid_lft forever preferred_lft forever 00:09:12.885 00:43:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:12.885 00:43:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:12.885 00:43:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:12.885 00:43:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:12.885 00:43:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:12.885 00:43:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:12.885 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:12.885 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:09:12.885 altname enp24s0f1np1 00:09:12.885 altname ens785f1np1 00:09:12.885 inet 192.168.100.9/24 scope global mlx_0_1 00:09:12.885 valid_lft forever preferred_lft forever 00:09:12.885 00:43:19 -- nvmf/common.sh@411 -- # return 0 00:09:12.885 00:43:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:12.885 00:43:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:12.885 00:43:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:12.885 00:43:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:12.885 00:43:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:12.885 00:43:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:12.885 00:43:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:12.885 00:43:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:12.885 00:43:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:12.885 00:43:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:12.885 00:43:19 -- nvmf/common.sh@105 -- # continue 2 00:09:12.885 00:43:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:12.885 00:43:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:12.885 00:43:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:12.886 00:43:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:12.886 00:43:19 -- nvmf/common.sh@105 -- # continue 2 00:09:12.886 00:43:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:12.886 00:43:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:12.886 00:43:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:12.886 00:43:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:12.886 00:43:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:12.886 00:43:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:12.886 00:43:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:12.886 00:43:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:12.886 192.168.100.9' 00:09:12.886 00:43:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:12.886 192.168.100.9' 00:09:12.886 00:43:19 -- nvmf/common.sh@446 -- # head -n 1 00:09:12.886 00:43:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:12.886 00:43:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:12.886 192.168.100.9' 00:09:12.886 00:43:19 -- nvmf/common.sh@447 -- # tail -n +2 00:09:12.886 00:43:19 -- nvmf/common.sh@447 -- # head -n 1 00:09:12.886 00:43:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:12.886 00:43:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:12.886 00:43:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:12.886 00:43:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:12.886 00:43:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:12.886 00:43:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:12.886 00:43:19 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:12.886 00:43:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:12.886 00:43:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:09:12.886 00:43:19 -- common/autotest_common.sh@10 -- # set +x 00:09:12.886 00:43:19 -- nvmf/common.sh@470 -- # nvmfpid=181138 00:09:12.886 00:43:19 -- nvmf/common.sh@471 -- # waitforlisten 181138 00:09:12.886 00:43:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:12.886 00:43:19 -- common/autotest_common.sh@817 -- # '[' -z 181138 ']' 00:09:12.886 00:43:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:12.886 00:43:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:09:12.886 00:43:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:12.886 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:12.886 00:43:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:09:12.886 00:43:19 -- common/autotest_common.sh@10 -- # set +x 00:09:12.886 [2024-04-26 00:43:19.802148] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:09:12.886 [2024-04-26 00:43:19.802191] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:12.886 EAL: No free 2048 kB hugepages reported on node 1 00:09:12.886 [2024-04-26 00:43:19.852550] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:12.886 [2024-04-26 00:43:19.922149] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:12.886 [2024-04-26 00:43:19.922183] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:12.886 [2024-04-26 00:43:19.922190] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:12.886 [2024-04-26 00:43:19.922195] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:12.886 [2024-04-26 00:43:19.922199] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:12.886 [2024-04-26 00:43:19.922238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:12.886 [2024-04-26 00:43:19.922264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:12.886 [2024-04-26 00:43:19.922348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:12.886 [2024-04-26 00:43:19.922350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:13.455 00:43:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:09:13.455 00:43:20 -- common/autotest_common.sh@850 -- # return 0 00:09:13.455 00:43:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:13.455 00:43:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:09:13.455 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.455 00:43:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:13.455 00:43:20 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:09:13.455 00:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.455 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.455 [2024-04-26 00:43:20.626919] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:09:13.455 [2024-04-26 00:43:20.646511] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xfde880/0xfe2d70) succeed. 00:09:13.715 [2024-04-26 00:43:20.655771] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xfdfec0/0x1024400) succeed. 00:09:13.715 00:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:13.715 00:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.715 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.715 00:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:13.715 00:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.715 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.715 00:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:13.715 00:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.715 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.715 00:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:13.715 00:43:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:09:13.715 00:43:20 -- common/autotest_common.sh@10 -- # set +x 00:09:13.715 [2024-04-26 00:43:20.785340] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:13.715 00:43:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:13.715 00:43:20 -- target/connect_disconnect.sh@34 -- # set +x 00:09:17.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.579 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.403 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.694 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.985 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.673 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.207 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.786 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.609 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.468 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.424 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.714 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.827 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.141 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.431 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.433 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.548 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.251 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.669 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.789 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.391 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:17.763 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.741 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.080 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.908 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.199 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.310 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.892 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:01.216 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:03.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:07.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:10.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:13.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.184 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.479 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:22.776 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:28.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:31.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:35.195 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:38.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:41.033 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:44.343 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:47.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:50.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:54.222 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:56.760 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:00.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:03.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:06.640 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:09.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:12.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:15.826 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:18.362 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:21.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:24.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:24.944 00:48:31 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:14:24.944 00:48:31 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:14:24.944 00:48:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:24.944 00:48:31 -- nvmf/common.sh@117 -- # sync 00:14:24.944 00:48:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:24.944 00:48:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:24.944 00:48:31 -- nvmf/common.sh@120 -- # set +e 00:14:24.944 00:48:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:24.944 00:48:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:24.944 rmmod nvme_rdma 00:14:24.944 rmmod nvme_fabrics 00:14:24.944 00:48:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:24.944 00:48:31 -- nvmf/common.sh@124 -- # set -e 00:14:24.944 00:48:31 -- nvmf/common.sh@125 -- # return 0 00:14:24.944 00:48:31 -- nvmf/common.sh@478 -- # '[' -n 181138 ']' 00:14:24.944 00:48:31 -- nvmf/common.sh@479 -- # killprocess 181138 00:14:24.944 00:48:31 -- common/autotest_common.sh@936 -- # '[' -z 181138 ']' 00:14:24.944 00:48:31 -- common/autotest_common.sh@940 -- # kill -0 181138 00:14:24.944 00:48:31 -- common/autotest_common.sh@941 -- # uname 00:14:24.944 00:48:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:24.944 00:48:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 181138 00:14:24.944 00:48:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:24.944 00:48:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:24.944 00:48:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 181138' 00:14:24.944 killing process with pid 181138 00:14:24.944 00:48:31 -- common/autotest_common.sh@955 -- # kill 181138 00:14:24.944 00:48:31 -- common/autotest_common.sh@960 -- # wait 181138 00:14:24.944 [2024-04-26 00:48:31.867991] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:24.944 00:48:32 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:24.944 00:48:32 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:24.944 00:14:24.944 real 5m17.528s 00:14:24.944 user 20m44.330s 00:14:24.944 sys 0m13.401s 00:14:24.944 00:48:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:24.944 00:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:24.944 ************************************ 00:14:24.944 END TEST nvmf_connect_disconnect 00:14:24.944 ************************************ 00:14:24.944 00:48:32 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:14:24.944 00:48:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:24.944 00:48:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:24.944 00:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:25.205 ************************************ 00:14:25.205 START TEST nvmf_multitarget 00:14:25.205 ************************************ 00:14:25.205 00:48:32 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:14:25.205 * Looking for test storage... 00:14:25.205 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:25.205 00:48:32 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:25.205 00:48:32 -- nvmf/common.sh@7 -- # uname -s 00:14:25.205 00:48:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:25.205 00:48:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:25.205 00:48:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:25.205 00:48:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:25.205 00:48:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:25.205 00:48:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:25.205 00:48:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:25.205 00:48:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:25.205 00:48:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:25.205 00:48:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:25.205 00:48:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:25.205 00:48:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:25.205 00:48:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:25.205 00:48:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:25.205 00:48:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:25.205 00:48:32 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:25.205 00:48:32 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:25.205 00:48:32 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:25.205 00:48:32 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:25.205 00:48:32 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:25.205 00:48:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.205 00:48:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.205 00:48:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.205 00:48:32 -- paths/export.sh@5 -- # export PATH 00:14:25.205 00:48:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:25.205 00:48:32 -- nvmf/common.sh@47 -- # : 0 00:14:25.205 00:48:32 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:25.205 00:48:32 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:25.205 00:48:32 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:25.205 00:48:32 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:25.205 00:48:32 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:25.205 00:48:32 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:25.205 00:48:32 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:25.205 00:48:32 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:25.205 00:48:32 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:14:25.205 00:48:32 -- target/multitarget.sh@15 -- # nvmftestinit 00:14:25.205 00:48:32 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:25.205 00:48:32 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:25.205 00:48:32 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:25.205 00:48:32 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:25.205 00:48:32 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:25.205 00:48:32 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:25.205 00:48:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:25.205 00:48:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:25.205 00:48:32 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:25.205 00:48:32 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:25.205 00:48:32 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:25.205 00:48:32 -- common/autotest_common.sh@10 -- # set +x 00:14:30.497 00:48:37 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:30.497 00:48:37 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:30.497 00:48:37 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:30.497 00:48:37 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:30.497 00:48:37 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:30.497 00:48:37 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:30.497 00:48:37 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:30.497 00:48:37 -- nvmf/common.sh@295 -- # net_devs=() 00:14:30.497 00:48:37 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:30.497 00:48:37 -- nvmf/common.sh@296 -- # e810=() 00:14:30.497 00:48:37 -- nvmf/common.sh@296 -- # local -ga e810 00:14:30.497 00:48:37 -- nvmf/common.sh@297 -- # x722=() 00:14:30.497 00:48:37 -- nvmf/common.sh@297 -- # local -ga x722 00:14:30.497 00:48:37 -- nvmf/common.sh@298 -- # mlx=() 00:14:30.497 00:48:37 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:30.497 00:48:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:30.497 00:48:37 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:30.497 00:48:37 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:30.497 00:48:37 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:30.497 00:48:37 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:30.497 00:48:37 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:30.497 00:48:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:30.497 00:48:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:30.497 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:30.497 00:48:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:30.497 00:48:37 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:30.497 00:48:37 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:30.497 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:30.497 00:48:37 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:30.497 00:48:37 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:30.497 00:48:37 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:30.497 00:48:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:30.497 00:48:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.497 00:48:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:30.497 00:48:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.497 00:48:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:30.497 Found net devices under 0000:18:00.0: mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.498 00:48:37 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:30.498 00:48:37 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:30.498 00:48:37 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:30.498 00:48:37 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:30.498 Found net devices under 0000:18:00.1: mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:30.498 00:48:37 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:30.498 00:48:37 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:30.498 00:48:37 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:30.498 00:48:37 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:30.498 00:48:37 -- nvmf/common.sh@58 -- # uname 00:14:30.498 00:48:37 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:30.498 00:48:37 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:30.498 00:48:37 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:30.498 00:48:37 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:30.498 00:48:37 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:30.498 00:48:37 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:30.498 00:48:37 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:30.498 00:48:37 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:30.498 00:48:37 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:30.498 00:48:37 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:30.498 00:48:37 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:30.498 00:48:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:30.498 00:48:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:30.498 00:48:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:30.498 00:48:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:30.498 00:48:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:30.498 00:48:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@105 -- # continue 2 00:14:30.498 00:48:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@105 -- # continue 2 00:14:30.498 00:48:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:30.498 00:48:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:30.498 00:48:37 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:30.498 00:48:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:30.498 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:30.498 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:14:30.498 altname enp24s0f0np0 00:14:30.498 altname ens785f0np0 00:14:30.498 inet 192.168.100.8/24 scope global mlx_0_0 00:14:30.498 valid_lft forever preferred_lft forever 00:14:30.498 00:48:37 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:30.498 00:48:37 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:30.498 00:48:37 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:30.498 00:48:37 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:30.498 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:30.498 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:14:30.498 altname enp24s0f1np1 00:14:30.498 altname ens785f1np1 00:14:30.498 inet 192.168.100.9/24 scope global mlx_0_1 00:14:30.498 valid_lft forever preferred_lft forever 00:14:30.498 00:48:37 -- nvmf/common.sh@411 -- # return 0 00:14:30.498 00:48:37 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:30.498 00:48:37 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:30.498 00:48:37 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:30.498 00:48:37 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:30.498 00:48:37 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:30.498 00:48:37 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:30.498 00:48:37 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:30.498 00:48:37 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:30.498 00:48:37 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:30.498 00:48:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@105 -- # continue 2 00:14:30.498 00:48:37 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:30.498 00:48:37 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:30.498 00:48:37 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@105 -- # continue 2 00:14:30.498 00:48:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:30.498 00:48:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:30.498 00:48:37 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:30.498 00:48:37 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:30.498 00:48:37 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:30.498 00:48:37 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:30.498 192.168.100.9' 00:14:30.498 00:48:37 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:30.498 192.168.100.9' 00:14:30.498 00:48:37 -- nvmf/common.sh@446 -- # head -n 1 00:14:30.498 00:48:37 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:30.498 00:48:37 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:30.498 192.168.100.9' 00:14:30.498 00:48:37 -- nvmf/common.sh@447 -- # tail -n +2 00:14:30.498 00:48:37 -- nvmf/common.sh@447 -- # head -n 1 00:14:30.498 00:48:37 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:30.498 00:48:37 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:30.498 00:48:37 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:30.498 00:48:37 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:30.498 00:48:37 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:30.498 00:48:37 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:30.498 00:48:37 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:14:30.498 00:48:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:30.498 00:48:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:30.498 00:48:37 -- common/autotest_common.sh@10 -- # set +x 00:14:30.498 00:48:37 -- nvmf/common.sh@470 -- # nvmfpid=243543 00:14:30.498 00:48:37 -- nvmf/common.sh@471 -- # waitforlisten 243543 00:14:30.498 00:48:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:30.498 00:48:37 -- common/autotest_common.sh@817 -- # '[' -z 243543 ']' 00:14:30.498 00:48:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:30.498 00:48:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:30.498 00:48:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:30.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:30.498 00:48:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:30.498 00:48:37 -- common/autotest_common.sh@10 -- # set +x 00:14:30.498 [2024-04-26 00:48:37.632001] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:14:30.498 [2024-04-26 00:48:37.632052] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:30.498 EAL: No free 2048 kB hugepages reported on node 1 00:14:30.498 [2024-04-26 00:48:37.685054] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:30.757 [2024-04-26 00:48:37.755650] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:30.757 [2024-04-26 00:48:37.755689] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:30.757 [2024-04-26 00:48:37.755698] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:30.757 [2024-04-26 00:48:37.755704] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:30.757 [2024-04-26 00:48:37.755708] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:30.757 [2024-04-26 00:48:37.755749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:30.757 [2024-04-26 00:48:37.755863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:30.757 [2024-04-26 00:48:37.755924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:30.757 [2024-04-26 00:48:37.755926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:31.326 00:48:38 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:31.326 00:48:38 -- common/autotest_common.sh@850 -- # return 0 00:14:31.326 00:48:38 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:31.326 00:48:38 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:31.327 00:48:38 -- common/autotest_common.sh@10 -- # set +x 00:14:31.327 00:48:38 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:31.327 00:48:38 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:14:31.327 00:48:38 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:31.327 00:48:38 -- target/multitarget.sh@21 -- # jq length 00:14:31.586 00:48:38 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:14:31.586 00:48:38 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:14:31.586 "nvmf_tgt_1" 00:14:31.586 00:48:38 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:14:31.586 "nvmf_tgt_2" 00:14:31.586 00:48:38 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:31.586 00:48:38 -- target/multitarget.sh@28 -- # jq length 00:14:31.845 00:48:38 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:14:31.845 00:48:38 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:14:31.845 true 00:14:31.845 00:48:38 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:14:31.845 true 00:14:31.845 00:48:39 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:14:31.845 00:48:39 -- target/multitarget.sh@35 -- # jq length 00:14:32.105 00:48:39 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:14:32.105 00:48:39 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:14:32.105 00:48:39 -- target/multitarget.sh@41 -- # nvmftestfini 00:14:32.105 00:48:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:32.105 00:48:39 -- nvmf/common.sh@117 -- # sync 00:14:32.105 00:48:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:32.105 00:48:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:32.105 00:48:39 -- nvmf/common.sh@120 -- # set +e 00:14:32.105 00:48:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:32.105 00:48:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:32.105 rmmod nvme_rdma 00:14:32.105 rmmod nvme_fabrics 00:14:32.105 00:48:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:32.105 00:48:39 -- nvmf/common.sh@124 -- # set -e 00:14:32.106 00:48:39 -- nvmf/common.sh@125 -- # return 0 00:14:32.106 00:48:39 -- nvmf/common.sh@478 -- # '[' -n 243543 ']' 00:14:32.106 00:48:39 -- nvmf/common.sh@479 -- # killprocess 243543 00:14:32.106 00:48:39 -- common/autotest_common.sh@936 -- # '[' -z 243543 ']' 00:14:32.106 00:48:39 -- common/autotest_common.sh@940 -- # kill -0 243543 00:14:32.106 00:48:39 -- common/autotest_common.sh@941 -- # uname 00:14:32.106 00:48:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:32.106 00:48:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 243543 00:14:32.106 00:48:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:32.106 00:48:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:32.106 00:48:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 243543' 00:14:32.106 killing process with pid 243543 00:14:32.106 00:48:39 -- common/autotest_common.sh@955 -- # kill 243543 00:14:32.106 00:48:39 -- common/autotest_common.sh@960 -- # wait 243543 00:14:32.365 00:48:39 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:32.365 00:48:39 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:32.365 00:14:32.365 real 0m7.181s 00:14:32.365 user 0m8.761s 00:14:32.365 sys 0m4.372s 00:14:32.365 00:48:39 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:14:32.365 00:48:39 -- common/autotest_common.sh@10 -- # set +x 00:14:32.365 ************************************ 00:14:32.365 END TEST nvmf_multitarget 00:14:32.365 ************************************ 00:14:32.365 00:48:39 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:14:32.365 00:48:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:32.365 00:48:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:32.365 00:48:39 -- common/autotest_common.sh@10 -- # set +x 00:14:32.625 ************************************ 00:14:32.625 START TEST nvmf_rpc 00:14:32.625 ************************************ 00:14:32.625 00:48:39 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:14:32.625 * Looking for test storage... 00:14:32.625 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:32.625 00:48:39 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:32.625 00:48:39 -- nvmf/common.sh@7 -- # uname -s 00:14:32.625 00:48:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:32.626 00:48:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:32.626 00:48:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:32.626 00:48:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:32.626 00:48:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:32.626 00:48:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:32.626 00:48:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:32.626 00:48:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:32.626 00:48:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:32.626 00:48:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:32.626 00:48:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:32.626 00:48:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:14:32.626 00:48:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:32.626 00:48:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:32.626 00:48:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:32.626 00:48:39 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:32.626 00:48:39 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:32.626 00:48:39 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:32.626 00:48:39 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:32.626 00:48:39 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:32.626 00:48:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.626 00:48:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.626 00:48:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.626 00:48:39 -- paths/export.sh@5 -- # export PATH 00:14:32.626 00:48:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:32.626 00:48:39 -- nvmf/common.sh@47 -- # : 0 00:14:32.626 00:48:39 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:32.626 00:48:39 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:32.626 00:48:39 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:32.626 00:48:39 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:32.626 00:48:39 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:32.626 00:48:39 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:32.626 00:48:39 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:32.626 00:48:39 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:32.626 00:48:39 -- target/rpc.sh@11 -- # loops=5 00:14:32.626 00:48:39 -- target/rpc.sh@23 -- # nvmftestinit 00:14:32.626 00:48:39 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:32.626 00:48:39 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:32.626 00:48:39 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:32.626 00:48:39 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:32.626 00:48:39 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:32.626 00:48:39 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:32.626 00:48:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:32.626 00:48:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:32.626 00:48:39 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:32.626 00:48:39 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:32.626 00:48:39 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:32.626 00:48:39 -- common/autotest_common.sh@10 -- # set +x 00:14:37.904 00:48:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:37.904 00:48:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:37.904 00:48:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:37.904 00:48:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:37.904 00:48:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:37.904 00:48:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:37.904 00:48:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:37.904 00:48:44 -- nvmf/common.sh@295 -- # net_devs=() 00:14:37.904 00:48:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:37.904 00:48:44 -- nvmf/common.sh@296 -- # e810=() 00:14:37.904 00:48:44 -- nvmf/common.sh@296 -- # local -ga e810 00:14:37.904 00:48:44 -- nvmf/common.sh@297 -- # x722=() 00:14:37.904 00:48:44 -- nvmf/common.sh@297 -- # local -ga x722 00:14:37.904 00:48:44 -- nvmf/common.sh@298 -- # mlx=() 00:14:37.904 00:48:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:37.904 00:48:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:37.904 00:48:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:37.905 00:48:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:37.905 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:37.905 00:48:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:37.905 00:48:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:37.905 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:37.905 00:48:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:37.905 00:48:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.905 00:48:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.905 00:48:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:37.905 Found net devices under 0000:18:00.0: mlx_0_0 00:14:37.905 00:48:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.905 00:48:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.905 00:48:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:37.905 Found net devices under 0000:18:00.1: mlx_0_1 00:14:37.905 00:48:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.905 00:48:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:37.905 00:48:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:37.905 00:48:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:37.905 00:48:44 -- nvmf/common.sh@58 -- # uname 00:14:37.905 00:48:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:37.905 00:48:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:37.905 00:48:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:37.905 00:48:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:37.905 00:48:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:37.905 00:48:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:37.905 00:48:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:37.905 00:48:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:37.905 00:48:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:37.905 00:48:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:37.905 00:48:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:37.905 00:48:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:37.905 00:48:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:37.905 00:48:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:37.905 00:48:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:37.905 00:48:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:37.905 00:48:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:37.905 00:48:44 -- nvmf/common.sh@105 -- # continue 2 00:14:37.905 00:48:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:37.905 00:48:44 -- nvmf/common.sh@105 -- # continue 2 00:14:37.905 00:48:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:37.905 00:48:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:37.905 00:48:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:37.905 00:48:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:37.905 00:48:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:37.905 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:37.905 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:14:37.905 altname enp24s0f0np0 00:14:37.905 altname ens785f0np0 00:14:37.905 inet 192.168.100.8/24 scope global mlx_0_0 00:14:37.905 valid_lft forever preferred_lft forever 00:14:37.905 00:48:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:37.905 00:48:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:37.905 00:48:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:37.905 00:48:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:37.905 00:48:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:37.905 00:48:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:37.905 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:37.905 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:14:37.905 altname enp24s0f1np1 00:14:37.905 altname ens785f1np1 00:14:37.905 inet 192.168.100.9/24 scope global mlx_0_1 00:14:37.905 valid_lft forever preferred_lft forever 00:14:37.905 00:48:44 -- nvmf/common.sh@411 -- # return 0 00:14:37.905 00:48:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:37.905 00:48:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:37.905 00:48:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:37.905 00:48:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:37.905 00:48:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:37.905 00:48:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:37.905 00:48:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:37.905 00:48:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:37.905 00:48:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:37.905 00:48:45 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:37.905 00:48:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:37.905 00:48:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:45 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:37.905 00:48:45 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:37.905 00:48:45 -- nvmf/common.sh@105 -- # continue 2 00:14:37.905 00:48:45 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:37.905 00:48:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:37.905 00:48:45 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:37.905 00:48:45 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:37.905 00:48:45 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:37.905 00:48:45 -- nvmf/common.sh@105 -- # continue 2 00:14:37.905 00:48:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:37.905 00:48:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:37.905 00:48:45 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:37.905 00:48:45 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:37.905 00:48:45 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:37.905 00:48:45 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:37.905 00:48:45 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:37.905 00:48:45 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:37.905 192.168.100.9' 00:14:37.905 00:48:45 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:37.905 192.168.100.9' 00:14:37.905 00:48:45 -- nvmf/common.sh@446 -- # head -n 1 00:14:37.905 00:48:45 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:37.905 00:48:45 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:37.905 192.168.100.9' 00:14:37.905 00:48:45 -- nvmf/common.sh@447 -- # tail -n +2 00:14:37.905 00:48:45 -- nvmf/common.sh@447 -- # head -n 1 00:14:37.905 00:48:45 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:37.906 00:48:45 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:37.906 00:48:45 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:37.906 00:48:45 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:37.906 00:48:45 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:37.906 00:48:45 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:37.906 00:48:45 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:14:37.906 00:48:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:37.906 00:48:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:14:37.906 00:48:45 -- common/autotest_common.sh@10 -- # set +x 00:14:37.906 00:48:45 -- nvmf/common.sh@470 -- # nvmfpid=247093 00:14:37.906 00:48:45 -- nvmf/common.sh@471 -- # waitforlisten 247093 00:14:37.906 00:48:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:37.906 00:48:45 -- common/autotest_common.sh@817 -- # '[' -z 247093 ']' 00:14:37.906 00:48:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:37.906 00:48:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:14:37.906 00:48:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:37.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:37.906 00:48:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:14:37.906 00:48:45 -- common/autotest_common.sh@10 -- # set +x 00:14:38.165 [2024-04-26 00:48:45.117421] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:14:38.165 [2024-04-26 00:48:45.117464] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:38.165 EAL: No free 2048 kB hugepages reported on node 1 00:14:38.165 [2024-04-26 00:48:45.169374] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:38.165 [2024-04-26 00:48:45.239214] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:38.165 [2024-04-26 00:48:45.239255] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:38.166 [2024-04-26 00:48:45.239261] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:38.166 [2024-04-26 00:48:45.239267] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:38.166 [2024-04-26 00:48:45.239271] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:38.166 [2024-04-26 00:48:45.239311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:38.166 [2024-04-26 00:48:45.239405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:38.166 [2024-04-26 00:48:45.239478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:38.166 [2024-04-26 00:48:45.239479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:38.733 00:48:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:14:38.733 00:48:45 -- common/autotest_common.sh@850 -- # return 0 00:14:38.733 00:48:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:38.733 00:48:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:14:38.733 00:48:45 -- common/autotest_common.sh@10 -- # set +x 00:14:38.992 00:48:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:38.992 00:48:45 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:14:38.992 00:48:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:38.992 00:48:45 -- common/autotest_common.sh@10 -- # set +x 00:14:38.992 00:48:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:38.992 00:48:45 -- target/rpc.sh@26 -- # stats='{ 00:14:38.992 "tick_rate": 2700000000, 00:14:38.992 "poll_groups": [ 00:14:38.992 { 00:14:38.992 "name": "nvmf_tgt_poll_group_0", 00:14:38.992 "admin_qpairs": 0, 00:14:38.992 "io_qpairs": 0, 00:14:38.992 "current_admin_qpairs": 0, 00:14:38.992 "current_io_qpairs": 0, 00:14:38.992 "pending_bdev_io": 0, 00:14:38.992 "completed_nvme_io": 0, 00:14:38.992 "transports": [] 00:14:38.992 }, 00:14:38.992 { 00:14:38.992 "name": "nvmf_tgt_poll_group_1", 00:14:38.992 "admin_qpairs": 0, 00:14:38.992 "io_qpairs": 0, 00:14:38.992 "current_admin_qpairs": 0, 00:14:38.992 "current_io_qpairs": 0, 00:14:38.992 "pending_bdev_io": 0, 00:14:38.992 "completed_nvme_io": 0, 00:14:38.992 "transports": [] 00:14:38.992 }, 00:14:38.992 { 00:14:38.992 "name": "nvmf_tgt_poll_group_2", 00:14:38.992 "admin_qpairs": 0, 00:14:38.992 "io_qpairs": 0, 00:14:38.992 "current_admin_qpairs": 0, 00:14:38.992 "current_io_qpairs": 0, 00:14:38.992 "pending_bdev_io": 0, 00:14:38.992 "completed_nvme_io": 0, 00:14:38.992 "transports": [] 00:14:38.992 }, 00:14:38.992 { 00:14:38.992 "name": "nvmf_tgt_poll_group_3", 00:14:38.992 "admin_qpairs": 0, 00:14:38.992 "io_qpairs": 0, 00:14:38.992 "current_admin_qpairs": 0, 00:14:38.992 "current_io_qpairs": 0, 00:14:38.992 "pending_bdev_io": 0, 00:14:38.992 "completed_nvme_io": 0, 00:14:38.992 "transports": [] 00:14:38.992 } 00:14:38.992 ] 00:14:38.992 }' 00:14:38.992 00:48:45 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:14:38.992 00:48:45 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:14:38.992 00:48:45 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:14:38.992 00:48:45 -- target/rpc.sh@15 -- # wc -l 00:14:38.992 00:48:45 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:14:38.992 00:48:45 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:14:38.992 00:48:46 -- target/rpc.sh@29 -- # [[ null == null ]] 00:14:38.992 00:48:46 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:38.992 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:38.992 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:38.992 [2024-04-26 00:48:46.056533] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x9a28b0/0x9a6da0) succeed. 00:14:38.992 [2024-04-26 00:48:46.065891] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x9a3ef0/0x9e8430) succeed. 00:14:38.992 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:38.992 00:48:46 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:14:38.992 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:38.992 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.251 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.251 00:48:46 -- target/rpc.sh@33 -- # stats='{ 00:14:39.251 "tick_rate": 2700000000, 00:14:39.251 "poll_groups": [ 00:14:39.251 { 00:14:39.251 "name": "nvmf_tgt_poll_group_0", 00:14:39.251 "admin_qpairs": 0, 00:14:39.251 "io_qpairs": 0, 00:14:39.251 "current_admin_qpairs": 0, 00:14:39.251 "current_io_qpairs": 0, 00:14:39.251 "pending_bdev_io": 0, 00:14:39.251 "completed_nvme_io": 0, 00:14:39.251 "transports": [ 00:14:39.251 { 00:14:39.251 "trtype": "RDMA", 00:14:39.251 "pending_data_buffer": 0, 00:14:39.251 "devices": [ 00:14:39.251 { 00:14:39.251 "name": "mlx5_0", 00:14:39.251 "polls": 14704, 00:14:39.251 "idle_polls": 14704, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "mlx5_1", 00:14:39.251 "polls": 14704, 00:14:39.251 "idle_polls": 14704, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "nvmf_tgt_poll_group_1", 00:14:39.251 "admin_qpairs": 0, 00:14:39.251 "io_qpairs": 0, 00:14:39.251 "current_admin_qpairs": 0, 00:14:39.251 "current_io_qpairs": 0, 00:14:39.251 "pending_bdev_io": 0, 00:14:39.251 "completed_nvme_io": 0, 00:14:39.251 "transports": [ 00:14:39.251 { 00:14:39.251 "trtype": "RDMA", 00:14:39.251 "pending_data_buffer": 0, 00:14:39.251 "devices": [ 00:14:39.251 { 00:14:39.251 "name": "mlx5_0", 00:14:39.251 "polls": 9221, 00:14:39.251 "idle_polls": 9221, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "mlx5_1", 00:14:39.251 "polls": 9221, 00:14:39.251 "idle_polls": 9221, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "nvmf_tgt_poll_group_2", 00:14:39.251 "admin_qpairs": 0, 00:14:39.251 "io_qpairs": 0, 00:14:39.251 "current_admin_qpairs": 0, 00:14:39.251 "current_io_qpairs": 0, 00:14:39.251 "pending_bdev_io": 0, 00:14:39.251 "completed_nvme_io": 0, 00:14:39.251 "transports": [ 00:14:39.251 { 00:14:39.251 "trtype": "RDMA", 00:14:39.251 "pending_data_buffer": 0, 00:14:39.251 "devices": [ 00:14:39.251 { 00:14:39.251 "name": "mlx5_0", 00:14:39.251 "polls": 5195, 00:14:39.251 "idle_polls": 5195, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "mlx5_1", 00:14:39.251 "polls": 5195, 00:14:39.251 "idle_polls": 5195, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 } 00:14:39.251 ] 00:14:39.251 }, 00:14:39.251 { 00:14:39.251 "name": "nvmf_tgt_poll_group_3", 00:14:39.251 "admin_qpairs": 0, 00:14:39.251 "io_qpairs": 0, 00:14:39.251 "current_admin_qpairs": 0, 00:14:39.251 "current_io_qpairs": 0, 00:14:39.251 "pending_bdev_io": 0, 00:14:39.251 "completed_nvme_io": 0, 00:14:39.251 "transports": [ 00:14:39.251 { 00:14:39.251 "trtype": "RDMA", 00:14:39.251 "pending_data_buffer": 0, 00:14:39.251 "devices": [ 00:14:39.251 { 00:14:39.251 "name": "mlx5_0", 00:14:39.251 "polls": 912, 00:14:39.251 "idle_polls": 912, 00:14:39.251 "completions": 0, 00:14:39.251 "requests": 0, 00:14:39.251 "request_latency": 0, 00:14:39.251 "pending_free_request": 0, 00:14:39.251 "pending_rdma_read": 0, 00:14:39.251 "pending_rdma_write": 0, 00:14:39.251 "pending_rdma_send": 0, 00:14:39.251 "total_send_wrs": 0, 00:14:39.251 "send_doorbell_updates": 0, 00:14:39.251 "total_recv_wrs": 4096, 00:14:39.251 "recv_doorbell_updates": 1 00:14:39.251 }, 00:14:39.252 { 00:14:39.252 "name": "mlx5_1", 00:14:39.252 "polls": 912, 00:14:39.252 "idle_polls": 912, 00:14:39.252 "completions": 0, 00:14:39.252 "requests": 0, 00:14:39.252 "request_latency": 0, 00:14:39.252 "pending_free_request": 0, 00:14:39.252 "pending_rdma_read": 0, 00:14:39.252 "pending_rdma_write": 0, 00:14:39.252 "pending_rdma_send": 0, 00:14:39.252 "total_send_wrs": 0, 00:14:39.252 "send_doorbell_updates": 0, 00:14:39.252 "total_recv_wrs": 4096, 00:14:39.252 "recv_doorbell_updates": 1 00:14:39.252 } 00:14:39.252 ] 00:14:39.252 } 00:14:39.252 ] 00:14:39.252 } 00:14:39.252 ] 00:14:39.252 }' 00:14:39.252 00:48:46 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:39.252 00:48:46 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:14:39.252 00:48:46 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:14:39.252 00:48:46 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:14:39.252 00:48:46 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:14:39.252 00:48:46 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:14:39.252 00:48:46 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:14:39.252 00:48:46 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:14:39.252 00:48:46 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:14:39.252 00:48:46 -- target/rpc.sh@15 -- # wc -l 00:14:39.252 00:48:46 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:14:39.252 00:48:46 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:14:39.252 00:48:46 -- target/rpc.sh@41 -- # transport_type=RDMA 00:14:39.252 00:48:46 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:14:39.252 00:48:46 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:14:39.252 00:48:46 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:14:39.252 00:48:46 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:14:39.252 00:48:46 -- target/rpc.sh@15 -- # wc -l 00:14:39.252 00:48:46 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:14:39.252 00:48:46 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:14:39.252 00:48:46 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:14:39.252 00:48:46 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:39.252 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.252 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.252 Malloc1 00:14:39.252 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.252 00:48:46 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:39.252 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.252 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.252 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.252 00:48:46 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:39.252 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.252 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.252 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.252 00:48:46 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:14:39.252 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.252 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.252 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.252 00:48:46 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:39.252 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.252 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.252 [2024-04-26 00:48:46.433792] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:39.252 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.252 00:48:46 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:39.252 00:48:46 -- common/autotest_common.sh@638 -- # local es=0 00:14:39.252 00:48:46 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:39.252 00:48:46 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:39.252 00:48:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.252 00:48:46 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:39.511 00:48:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.511 00:48:46 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:39.511 00:48:46 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:39.511 00:48:46 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:39.511 00:48:46 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:39.511 00:48:46 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:14:39.511 [2024-04-26 00:48:46.476648] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562' 00:14:39.511 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:39.511 could not add new controller: failed to write to nvme-fabrics device 00:14:39.511 00:48:46 -- common/autotest_common.sh@641 -- # es=1 00:14:39.511 00:48:46 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:39.511 00:48:46 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:39.511 00:48:46 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:39.511 00:48:46 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:39.511 00:48:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:39.511 00:48:46 -- common/autotest_common.sh@10 -- # set +x 00:14:39.511 00:48:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:39.511 00:48:46 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:40.448 00:48:47 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:14:40.448 00:48:47 -- common/autotest_common.sh@1184 -- # local i=0 00:14:40.448 00:48:47 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:40.448 00:48:47 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:40.448 00:48:47 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:42.352 00:48:49 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:42.352 00:48:49 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:42.352 00:48:49 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:42.352 00:48:49 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:42.352 00:48:49 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:42.352 00:48:49 -- common/autotest_common.sh@1194 -- # return 0 00:14:42.352 00:48:49 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:43.299 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:43.299 00:48:50 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:43.299 00:48:50 -- common/autotest_common.sh@1205 -- # local i=0 00:14:43.299 00:48:50 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:43.299 00:48:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:43.299 00:48:50 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:43.299 00:48:50 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:43.299 00:48:50 -- common/autotest_common.sh@1217 -- # return 0 00:14:43.299 00:48:50 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:14:43.299 00:48:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:43.299 00:48:50 -- common/autotest_common.sh@10 -- # set +x 00:14:43.299 00:48:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:43.299 00:48:50 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:43.299 00:48:50 -- common/autotest_common.sh@638 -- # local es=0 00:14:43.299 00:48:50 -- common/autotest_common.sh@640 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:43.299 00:48:50 -- common/autotest_common.sh@626 -- # local arg=nvme 00:14:43.299 00:48:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.299 00:48:50 -- common/autotest_common.sh@630 -- # type -t nvme 00:14:43.299 00:48:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.299 00:48:50 -- common/autotest_common.sh@632 -- # type -P nvme 00:14:43.299 00:48:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:14:43.299 00:48:50 -- common/autotest_common.sh@632 -- # arg=/usr/sbin/nvme 00:14:43.299 00:48:50 -- common/autotest_common.sh@632 -- # [[ -x /usr/sbin/nvme ]] 00:14:43.299 00:48:50 -- common/autotest_common.sh@641 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:43.558 [2024-04-26 00:48:50.518211] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562' 00:14:43.559 Failed to write to /dev/nvme-fabrics: Input/output error 00:14:43.559 could not add new controller: failed to write to nvme-fabrics device 00:14:43.559 00:48:50 -- common/autotest_common.sh@641 -- # es=1 00:14:43.559 00:48:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:14:43.559 00:48:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:14:43.559 00:48:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:14:43.559 00:48:50 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:14:43.559 00:48:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:43.559 00:48:50 -- common/autotest_common.sh@10 -- # set +x 00:14:43.559 00:48:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:43.559 00:48:50 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:44.500 00:48:51 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:14:44.500 00:48:51 -- common/autotest_common.sh@1184 -- # local i=0 00:14:44.500 00:48:51 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:44.500 00:48:51 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:44.500 00:48:51 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:46.411 00:48:53 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:46.411 00:48:53 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:46.411 00:48:53 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:46.411 00:48:53 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:46.411 00:48:53 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:46.411 00:48:53 -- common/autotest_common.sh@1194 -- # return 0 00:14:46.411 00:48:53 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:47.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:47.352 00:48:54 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:47.352 00:48:54 -- common/autotest_common.sh@1205 -- # local i=0 00:14:47.352 00:48:54 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:47.352 00:48:54 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:47.352 00:48:54 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:47.352 00:48:54 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:47.352 00:48:54 -- common/autotest_common.sh@1217 -- # return 0 00:14:47.352 00:48:54 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:47.352 00:48:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.352 00:48:54 -- common/autotest_common.sh@10 -- # set +x 00:14:47.352 00:48:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.613 00:48:54 -- target/rpc.sh@81 -- # seq 1 5 00:14:47.613 00:48:54 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:47.613 00:48:54 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:47.613 00:48:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.613 00:48:54 -- common/autotest_common.sh@10 -- # set +x 00:14:47.613 00:48:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.613 00:48:54 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:47.613 00:48:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.613 00:48:54 -- common/autotest_common.sh@10 -- # set +x 00:14:47.613 [2024-04-26 00:48:54.566971] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:47.613 00:48:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.613 00:48:54 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:47.613 00:48:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.613 00:48:54 -- common/autotest_common.sh@10 -- # set +x 00:14:47.613 00:48:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.613 00:48:54 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:47.613 00:48:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:47.613 00:48:54 -- common/autotest_common.sh@10 -- # set +x 00:14:47.613 00:48:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:47.613 00:48:54 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:48.553 00:48:55 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:48.553 00:48:55 -- common/autotest_common.sh@1184 -- # local i=0 00:14:48.553 00:48:55 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:48.553 00:48:55 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:48.553 00:48:55 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:50.464 00:48:57 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:50.464 00:48:57 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:50.464 00:48:57 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:50.464 00:48:57 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:50.464 00:48:57 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:50.464 00:48:57 -- common/autotest_common.sh@1194 -- # return 0 00:14:50.464 00:48:57 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:51.407 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:51.407 00:48:58 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:51.407 00:48:58 -- common/autotest_common.sh@1205 -- # local i=0 00:14:51.407 00:48:58 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:51.407 00:48:58 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:51.407 00:48:58 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:51.407 00:48:58 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:51.407 00:48:58 -- common/autotest_common.sh@1217 -- # return 0 00:14:51.407 00:48:58 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:51.407 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.407 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.407 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.407 00:48:58 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:51.407 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.407 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.407 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.407 00:48:58 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:51.407 00:48:58 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:51.407 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.407 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.407 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.407 00:48:58 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:51.407 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.407 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.407 [2024-04-26 00:48:58.568139] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:51.407 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.408 00:48:58 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:51.408 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.408 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.408 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.408 00:48:58 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:51.408 00:48:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:51.408 00:48:58 -- common/autotest_common.sh@10 -- # set +x 00:14:51.408 00:48:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:51.408 00:48:58 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:52.790 00:48:59 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:52.790 00:48:59 -- common/autotest_common.sh@1184 -- # local i=0 00:14:52.790 00:48:59 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:52.790 00:48:59 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:52.790 00:48:59 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:54.698 00:49:01 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:54.699 00:49:01 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:54.699 00:49:01 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:54.699 00:49:01 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:54.699 00:49:01 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:54.699 00:49:01 -- common/autotest_common.sh@1194 -- # return 0 00:14:54.699 00:49:01 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:55.637 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:55.637 00:49:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:55.637 00:49:02 -- common/autotest_common.sh@1205 -- # local i=0 00:14:55.637 00:49:02 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:55.637 00:49:02 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:55.637 00:49:02 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:55.637 00:49:02 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:55.637 00:49:02 -- common/autotest_common.sh@1217 -- # return 0 00:14:55.637 00:49:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:55.637 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.637 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.637 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.637 00:49:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:55.637 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.637 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.637 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.637 00:49:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:55.637 00:49:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:55.637 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.637 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.637 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.637 00:49:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:55.637 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.637 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.637 [2024-04-26 00:49:02.571379] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:55.637 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.637 00:49:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:55.637 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.637 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.638 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.638 00:49:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:55.638 00:49:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:55.638 00:49:02 -- common/autotest_common.sh@10 -- # set +x 00:14:55.638 00:49:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:55.638 00:49:02 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:56.575 00:49:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:14:56.576 00:49:03 -- common/autotest_common.sh@1184 -- # local i=0 00:14:56.576 00:49:03 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:14:56.576 00:49:03 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:14:56.576 00:49:03 -- common/autotest_common.sh@1191 -- # sleep 2 00:14:58.485 00:49:05 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:14:58.485 00:49:05 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:14:58.485 00:49:05 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:14:58.485 00:49:05 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:14:58.485 00:49:05 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:14:58.485 00:49:05 -- common/autotest_common.sh@1194 -- # return 0 00:14:58.485 00:49:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:59.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:59.425 00:49:06 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:59.425 00:49:06 -- common/autotest_common.sh@1205 -- # local i=0 00:14:59.425 00:49:06 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:14:59.425 00:49:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:59.425 00:49:06 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:14:59.425 00:49:06 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:59.425 00:49:06 -- common/autotest_common.sh@1217 -- # return 0 00:14:59.425 00:49:06 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:59.425 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.425 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.425 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.425 00:49:06 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:59.425 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.425 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.425 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.425 00:49:06 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:14:59.426 00:49:06 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:14:59.426 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.426 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.426 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.426 00:49:06 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:59.426 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.426 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.426 [2024-04-26 00:49:06.569625] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:59.426 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.426 00:49:06 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:14:59.426 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.426 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.426 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.426 00:49:06 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:14:59.426 00:49:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:14:59.426 00:49:06 -- common/autotest_common.sh@10 -- # set +x 00:14:59.426 00:49:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:14:59.426 00:49:06 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:15:00.367 00:49:07 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:00.367 00:49:07 -- common/autotest_common.sh@1184 -- # local i=0 00:15:00.367 00:49:07 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:15:00.367 00:49:07 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:15:00.367 00:49:07 -- common/autotest_common.sh@1191 -- # sleep 2 00:15:02.905 00:49:09 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:15:02.905 00:49:09 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:15:02.905 00:49:09 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:15:02.905 00:49:09 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:15:02.905 00:49:09 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:15:02.905 00:49:09 -- common/autotest_common.sh@1194 -- # return 0 00:15:02.905 00:49:09 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:03.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:03.474 00:49:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:03.474 00:49:10 -- common/autotest_common.sh@1205 -- # local i=0 00:15:03.474 00:49:10 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:15:03.474 00:49:10 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.474 00:49:10 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:15:03.474 00:49:10 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.474 00:49:10 -- common/autotest_common.sh@1217 -- # return 0 00:15:03.474 00:49:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:03.474 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.474 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.474 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.474 00:49:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:03.475 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.475 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.475 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.475 00:49:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:15:03.475 00:49:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:03.475 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.475 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.475 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.475 00:49:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:03.475 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.475 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.475 [2024-04-26 00:49:10.547525] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:03.475 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.475 00:49:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:15:03.475 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.475 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.475 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.475 00:49:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:03.475 00:49:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:03.475 00:49:10 -- common/autotest_common.sh@10 -- # set +x 00:15:03.475 00:49:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:03.475 00:49:10 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:15:04.414 00:49:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:15:04.414 00:49:11 -- common/autotest_common.sh@1184 -- # local i=0 00:15:04.414 00:49:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:15:04.414 00:49:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:15:04.414 00:49:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:15:06.954 00:49:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:15:06.954 00:49:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:15:06.954 00:49:13 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:15:06.954 00:49:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:15:06.954 00:49:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:15:06.954 00:49:13 -- common/autotest_common.sh@1194 -- # return 0 00:15:06.954 00:49:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:07.525 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:07.525 00:49:14 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@1205 -- # local i=0 00:15:07.525 00:49:14 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:15:07.525 00:49:14 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:15:07.525 00:49:14 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@1217 -- # return 0 00:15:07.525 00:49:14 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@99 -- # seq 1 5 00:15:07.525 00:49:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:07.525 00:49:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 [2024-04-26 00:49:14.573191] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:07.525 00:49:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 [2024-04-26 00:49:14.621340] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:07.525 00:49:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 [2024-04-26 00:49:14.669513] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.525 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.525 00:49:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:07.525 00:49:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.525 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.525 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 [2024-04-26 00:49:14.721694] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:15:07.785 00:49:14 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 [2024-04-26 00:49:14.769863] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:15:07.785 00:49:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:07.785 00:49:14 -- common/autotest_common.sh@10 -- # set +x 00:15:07.785 00:49:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:07.785 00:49:14 -- target/rpc.sh@110 -- # stats='{ 00:15:07.785 "tick_rate": 2700000000, 00:15:07.785 "poll_groups": [ 00:15:07.785 { 00:15:07.785 "name": "nvmf_tgt_poll_group_0", 00:15:07.785 "admin_qpairs": 2, 00:15:07.785 "io_qpairs": 27, 00:15:07.785 "current_admin_qpairs": 0, 00:15:07.785 "current_io_qpairs": 0, 00:15:07.785 "pending_bdev_io": 0, 00:15:07.785 "completed_nvme_io": 128, 00:15:07.785 "transports": [ 00:15:07.785 { 00:15:07.785 "trtype": "RDMA", 00:15:07.785 "pending_data_buffer": 0, 00:15:07.785 "devices": [ 00:15:07.785 { 00:15:07.785 "name": "mlx5_0", 00:15:07.785 "polls": 3577619, 00:15:07.785 "idle_polls": 3577287, 00:15:07.785 "completions": 371, 00:15:07.785 "requests": 185, 00:15:07.785 "request_latency": 38487064, 00:15:07.785 "pending_free_request": 0, 00:15:07.785 "pending_rdma_read": 0, 00:15:07.785 "pending_rdma_write": 0, 00:15:07.785 "pending_rdma_send": 0, 00:15:07.785 "total_send_wrs": 313, 00:15:07.785 "send_doorbell_updates": 161, 00:15:07.785 "total_recv_wrs": 4281, 00:15:07.785 "recv_doorbell_updates": 161 00:15:07.785 }, 00:15:07.785 { 00:15:07.785 "name": "mlx5_1", 00:15:07.785 "polls": 3577619, 00:15:07.785 "idle_polls": 3577619, 00:15:07.785 "completions": 0, 00:15:07.785 "requests": 0, 00:15:07.785 "request_latency": 0, 00:15:07.785 "pending_free_request": 0, 00:15:07.785 "pending_rdma_read": 0, 00:15:07.785 "pending_rdma_write": 0, 00:15:07.785 "pending_rdma_send": 0, 00:15:07.785 "total_send_wrs": 0, 00:15:07.785 "send_doorbell_updates": 0, 00:15:07.785 "total_recv_wrs": 4096, 00:15:07.785 "recv_doorbell_updates": 1 00:15:07.785 } 00:15:07.785 ] 00:15:07.785 } 00:15:07.785 ] 00:15:07.785 }, 00:15:07.785 { 00:15:07.785 "name": "nvmf_tgt_poll_group_1", 00:15:07.785 "admin_qpairs": 2, 00:15:07.785 "io_qpairs": 26, 00:15:07.785 "current_admin_qpairs": 0, 00:15:07.785 "current_io_qpairs": 0, 00:15:07.785 "pending_bdev_io": 0, 00:15:07.785 "completed_nvme_io": 126, 00:15:07.785 "transports": [ 00:15:07.785 { 00:15:07.785 "trtype": "RDMA", 00:15:07.785 "pending_data_buffer": 0, 00:15:07.785 "devices": [ 00:15:07.785 { 00:15:07.785 "name": "mlx5_0", 00:15:07.785 "polls": 3500592, 00:15:07.785 "idle_polls": 3500272, 00:15:07.785 "completions": 360, 00:15:07.785 "requests": 180, 00:15:07.785 "request_latency": 37757190, 00:15:07.785 "pending_free_request": 0, 00:15:07.785 "pending_rdma_read": 0, 00:15:07.785 "pending_rdma_write": 0, 00:15:07.785 "pending_rdma_send": 0, 00:15:07.785 "total_send_wrs": 304, 00:15:07.785 "send_doorbell_updates": 154, 00:15:07.785 "total_recv_wrs": 4276, 00:15:07.785 "recv_doorbell_updates": 155 00:15:07.785 }, 00:15:07.785 { 00:15:07.785 "name": "mlx5_1", 00:15:07.785 "polls": 3500592, 00:15:07.785 "idle_polls": 3500592, 00:15:07.785 "completions": 0, 00:15:07.785 "requests": 0, 00:15:07.785 "request_latency": 0, 00:15:07.785 "pending_free_request": 0, 00:15:07.785 "pending_rdma_read": 0, 00:15:07.785 "pending_rdma_write": 0, 00:15:07.785 "pending_rdma_send": 0, 00:15:07.785 "total_send_wrs": 0, 00:15:07.785 "send_doorbell_updates": 0, 00:15:07.785 "total_recv_wrs": 4096, 00:15:07.785 "recv_doorbell_updates": 1 00:15:07.785 } 00:15:07.785 ] 00:15:07.785 } 00:15:07.785 ] 00:15:07.785 }, 00:15:07.785 { 00:15:07.785 "name": "nvmf_tgt_poll_group_2", 00:15:07.785 "admin_qpairs": 1, 00:15:07.785 "io_qpairs": 26, 00:15:07.785 "current_admin_qpairs": 0, 00:15:07.785 "current_io_qpairs": 0, 00:15:07.785 "pending_bdev_io": 0, 00:15:07.785 "completed_nvme_io": 76, 00:15:07.785 "transports": [ 00:15:07.785 { 00:15:07.785 "trtype": "RDMA", 00:15:07.785 "pending_data_buffer": 0, 00:15:07.785 "devices": [ 00:15:07.785 { 00:15:07.785 "name": "mlx5_0", 00:15:07.785 "polls": 3596036, 00:15:07.785 "idle_polls": 3595849, 00:15:07.785 "completions": 207, 00:15:07.785 "requests": 103, 00:15:07.785 "request_latency": 20955906, 00:15:07.785 "pending_free_request": 0, 00:15:07.785 "pending_rdma_read": 0, 00:15:07.785 "pending_rdma_write": 0, 00:15:07.786 "pending_rdma_send": 0, 00:15:07.786 "total_send_wrs": 166, 00:15:07.786 "send_doorbell_updates": 91, 00:15:07.786 "total_recv_wrs": 4199, 00:15:07.786 "recv_doorbell_updates": 91 00:15:07.786 }, 00:15:07.786 { 00:15:07.786 "name": "mlx5_1", 00:15:07.786 "polls": 3596036, 00:15:07.786 "idle_polls": 3596036, 00:15:07.786 "completions": 0, 00:15:07.786 "requests": 0, 00:15:07.786 "request_latency": 0, 00:15:07.786 "pending_free_request": 0, 00:15:07.786 "pending_rdma_read": 0, 00:15:07.786 "pending_rdma_write": 0, 00:15:07.786 "pending_rdma_send": 0, 00:15:07.786 "total_send_wrs": 0, 00:15:07.786 "send_doorbell_updates": 0, 00:15:07.786 "total_recv_wrs": 4096, 00:15:07.786 "recv_doorbell_updates": 1 00:15:07.786 } 00:15:07.786 ] 00:15:07.786 } 00:15:07.786 ] 00:15:07.786 }, 00:15:07.786 { 00:15:07.786 "name": "nvmf_tgt_poll_group_3", 00:15:07.786 "admin_qpairs": 2, 00:15:07.786 "io_qpairs": 26, 00:15:07.786 "current_admin_qpairs": 0, 00:15:07.786 "current_io_qpairs": 0, 00:15:07.786 "pending_bdev_io": 0, 00:15:07.786 "completed_nvme_io": 125, 00:15:07.786 "transports": [ 00:15:07.786 { 00:15:07.786 "trtype": "RDMA", 00:15:07.786 "pending_data_buffer": 0, 00:15:07.786 "devices": [ 00:15:07.786 { 00:15:07.786 "name": "mlx5_0", 00:15:07.786 "polls": 2864071, 00:15:07.786 "idle_polls": 2863757, 00:15:07.786 "completions": 360, 00:15:07.786 "requests": 180, 00:15:07.786 "request_latency": 38846754, 00:15:07.786 "pending_free_request": 0, 00:15:07.786 "pending_rdma_read": 0, 00:15:07.786 "pending_rdma_write": 0, 00:15:07.786 "pending_rdma_send": 0, 00:15:07.786 "total_send_wrs": 305, 00:15:07.786 "send_doorbell_updates": 155, 00:15:07.786 "total_recv_wrs": 4276, 00:15:07.786 "recv_doorbell_updates": 156 00:15:07.786 }, 00:15:07.786 { 00:15:07.786 "name": "mlx5_1", 00:15:07.786 "polls": 2864071, 00:15:07.786 "idle_polls": 2864071, 00:15:07.786 "completions": 0, 00:15:07.786 "requests": 0, 00:15:07.786 "request_latency": 0, 00:15:07.786 "pending_free_request": 0, 00:15:07.786 "pending_rdma_read": 0, 00:15:07.786 "pending_rdma_write": 0, 00:15:07.786 "pending_rdma_send": 0, 00:15:07.786 "total_send_wrs": 0, 00:15:07.786 "send_doorbell_updates": 0, 00:15:07.786 "total_recv_wrs": 4096, 00:15:07.786 "recv_doorbell_updates": 1 00:15:07.786 } 00:15:07.786 ] 00:15:07.786 } 00:15:07.786 ] 00:15:07.786 } 00:15:07.786 ] 00:15:07.786 }' 00:15:07.786 00:49:14 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:07.786 00:49:14 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:15:07.786 00:49:14 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:07.786 00:49:14 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:15:07.786 00:49:14 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:15:07.786 00:49:14 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:15:07.786 00:49:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:07.786 00:49:14 -- target/rpc.sh@117 -- # (( 1298 > 0 )) 00:15:07.786 00:49:14 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:15:07.786 00:49:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:15:07.786 00:49:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:15:08.045 00:49:14 -- target/rpc.sh@118 -- # (( 136046914 > 0 )) 00:15:08.045 00:49:14 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:15:08.045 00:49:14 -- target/rpc.sh@123 -- # nvmftestfini 00:15:08.045 00:49:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:08.045 00:49:14 -- nvmf/common.sh@117 -- # sync 00:15:08.045 00:49:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:08.045 00:49:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:08.045 00:49:15 -- nvmf/common.sh@120 -- # set +e 00:15:08.045 00:49:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:08.045 00:49:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:08.045 rmmod nvme_rdma 00:15:08.045 rmmod nvme_fabrics 00:15:08.045 00:49:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:08.045 00:49:15 -- nvmf/common.sh@124 -- # set -e 00:15:08.045 00:49:15 -- nvmf/common.sh@125 -- # return 0 00:15:08.045 00:49:15 -- nvmf/common.sh@478 -- # '[' -n 247093 ']' 00:15:08.045 00:49:15 -- nvmf/common.sh@479 -- # killprocess 247093 00:15:08.045 00:49:15 -- common/autotest_common.sh@936 -- # '[' -z 247093 ']' 00:15:08.045 00:49:15 -- common/autotest_common.sh@940 -- # kill -0 247093 00:15:08.045 00:49:15 -- common/autotest_common.sh@941 -- # uname 00:15:08.045 00:49:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:08.045 00:49:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 247093 00:15:08.045 00:49:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:08.045 00:49:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:08.045 00:49:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 247093' 00:15:08.045 killing process with pid 247093 00:15:08.045 00:49:15 -- common/autotest_common.sh@955 -- # kill 247093 00:15:08.045 00:49:15 -- common/autotest_common.sh@960 -- # wait 247093 00:15:08.045 [2024-04-26 00:49:15.160604] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:08.304 00:49:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:08.304 00:49:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:08.304 00:15:08.304 real 0m35.794s 00:15:08.304 user 2m1.779s 00:15:08.304 sys 0m5.390s 00:15:08.304 00:49:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:08.304 00:49:15 -- common/autotest_common.sh@10 -- # set +x 00:15:08.304 ************************************ 00:15:08.304 END TEST nvmf_rpc 00:15:08.304 ************************************ 00:15:08.304 00:49:15 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:15:08.304 00:49:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:08.304 00:49:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:08.304 00:49:15 -- common/autotest_common.sh@10 -- # set +x 00:15:08.564 ************************************ 00:15:08.564 START TEST nvmf_invalid 00:15:08.564 ************************************ 00:15:08.564 00:49:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:15:08.564 * Looking for test storage... 00:15:08.565 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:08.565 00:49:15 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:08.565 00:49:15 -- nvmf/common.sh@7 -- # uname -s 00:15:08.565 00:49:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:08.565 00:49:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:08.565 00:49:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:08.565 00:49:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:08.565 00:49:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:08.565 00:49:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:08.565 00:49:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:08.565 00:49:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:08.565 00:49:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:08.565 00:49:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:08.565 00:49:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:15:08.565 00:49:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:15:08.565 00:49:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:08.565 00:49:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:08.565 00:49:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:08.565 00:49:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:08.565 00:49:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:08.565 00:49:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:08.565 00:49:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:08.565 00:49:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:08.565 00:49:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.565 00:49:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.565 00:49:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.565 00:49:15 -- paths/export.sh@5 -- # export PATH 00:15:08.565 00:49:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.565 00:49:15 -- nvmf/common.sh@47 -- # : 0 00:15:08.565 00:49:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:08.565 00:49:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:08.565 00:49:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:08.565 00:49:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:08.565 00:49:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:08.565 00:49:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:08.565 00:49:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:08.565 00:49:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:08.565 00:49:15 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:15:08.565 00:49:15 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:08.565 00:49:15 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:15:08.565 00:49:15 -- target/invalid.sh@14 -- # target=foobar 00:15:08.565 00:49:15 -- target/invalid.sh@16 -- # RANDOM=0 00:15:08.565 00:49:15 -- target/invalid.sh@34 -- # nvmftestinit 00:15:08.565 00:49:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:08.565 00:49:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:08.565 00:49:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:08.565 00:49:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:08.565 00:49:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:08.565 00:49:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.565 00:49:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.565 00:49:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.565 00:49:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:08.565 00:49:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:08.565 00:49:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:08.565 00:49:15 -- common/autotest_common.sh@10 -- # set +x 00:15:13.848 00:49:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:13.848 00:49:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:13.848 00:49:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:13.848 00:49:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:13.848 00:49:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:13.848 00:49:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:13.848 00:49:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:13.848 00:49:20 -- nvmf/common.sh@295 -- # net_devs=() 00:15:13.848 00:49:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:13.848 00:49:20 -- nvmf/common.sh@296 -- # e810=() 00:15:13.848 00:49:20 -- nvmf/common.sh@296 -- # local -ga e810 00:15:13.848 00:49:20 -- nvmf/common.sh@297 -- # x722=() 00:15:13.848 00:49:20 -- nvmf/common.sh@297 -- # local -ga x722 00:15:13.848 00:49:20 -- nvmf/common.sh@298 -- # mlx=() 00:15:13.848 00:49:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:13.848 00:49:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:13.848 00:49:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:13.848 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:13.848 00:49:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.848 00:49:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:13.848 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:13.848 00:49:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:13.848 00:49:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.848 00:49:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.848 00:49:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:13.848 Found net devices under 0000:18:00.0: mlx_0_0 00:15:13.848 00:49:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:13.848 00:49:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:13.848 00:49:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:13.848 Found net devices under 0000:18:00.1: mlx_0_1 00:15:13.848 00:49:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:13.848 00:49:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:13.848 00:49:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:13.848 00:49:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:13.848 00:49:20 -- nvmf/common.sh@58 -- # uname 00:15:13.848 00:49:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:13.848 00:49:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:13.848 00:49:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:13.848 00:49:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:13.848 00:49:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:13.848 00:49:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:13.848 00:49:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:13.848 00:49:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:13.848 00:49:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:13.848 00:49:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:13.848 00:49:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:13.848 00:49:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.848 00:49:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.848 00:49:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.848 00:49:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.848 00:49:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.848 00:49:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.848 00:49:20 -- nvmf/common.sh@105 -- # continue 2 00:15:13.848 00:49:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.848 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.848 00:49:20 -- nvmf/common.sh@105 -- # continue 2 00:15:13.848 00:49:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.848 00:49:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:13.848 00:49:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.848 00:49:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.848 00:49:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.848 00:49:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.848 00:49:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:13.848 00:49:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:13.848 00:49:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:13.848 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.848 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:13.848 altname enp24s0f0np0 00:15:13.848 altname ens785f0np0 00:15:13.848 inet 192.168.100.8/24 scope global mlx_0_0 00:15:13.849 valid_lft forever preferred_lft forever 00:15:13.849 00:49:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:13.849 00:49:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.849 00:49:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:13.849 00:49:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:13.849 00:49:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:13.849 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:13.849 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:13.849 altname enp24s0f1np1 00:15:13.849 altname ens785f1np1 00:15:13.849 inet 192.168.100.9/24 scope global mlx_0_1 00:15:13.849 valid_lft forever preferred_lft forever 00:15:13.849 00:49:20 -- nvmf/common.sh@411 -- # return 0 00:15:13.849 00:49:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:13.849 00:49:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:13.849 00:49:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:13.849 00:49:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:13.849 00:49:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:13.849 00:49:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:13.849 00:49:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:13.849 00:49:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:13.849 00:49:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:13.849 00:49:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:13.849 00:49:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.849 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.849 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:13.849 00:49:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:13.849 00:49:20 -- nvmf/common.sh@105 -- # continue 2 00:15:13.849 00:49:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:13.849 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.849 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:13.849 00:49:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:13.849 00:49:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:13.849 00:49:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@105 -- # continue 2 00:15:13.849 00:49:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.849 00:49:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:13.849 00:49:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.849 00:49:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:13.849 00:49:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:13.849 00:49:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:13.849 00:49:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:13.849 192.168.100.9' 00:15:13.849 00:49:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:13.849 192.168.100.9' 00:15:13.849 00:49:20 -- nvmf/common.sh@446 -- # head -n 1 00:15:13.849 00:49:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:13.849 00:49:20 -- nvmf/common.sh@447 -- # head -n 1 00:15:13.849 00:49:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:13.849 192.168.100.9' 00:15:13.849 00:49:20 -- nvmf/common.sh@447 -- # tail -n +2 00:15:13.849 00:49:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:13.849 00:49:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:13.849 00:49:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:13.849 00:49:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:13.849 00:49:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:13.849 00:49:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:13.849 00:49:20 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:15:13.849 00:49:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:13.849 00:49:20 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:13.849 00:49:20 -- common/autotest_common.sh@10 -- # set +x 00:15:13.849 00:49:20 -- nvmf/common.sh@470 -- # nvmfpid=256017 00:15:13.849 00:49:20 -- nvmf/common.sh@471 -- # waitforlisten 256017 00:15:13.849 00:49:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:13.849 00:49:20 -- common/autotest_common.sh@817 -- # '[' -z 256017 ']' 00:15:13.849 00:49:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:13.849 00:49:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:13.849 00:49:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:13.849 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:13.849 00:49:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:13.849 00:49:20 -- common/autotest_common.sh@10 -- # set +x 00:15:13.849 [2024-04-26 00:49:20.667352] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:15:13.849 [2024-04-26 00:49:20.667398] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:13.849 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.849 [2024-04-26 00:49:20.718087] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:13.849 [2024-04-26 00:49:20.790791] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:13.849 [2024-04-26 00:49:20.790826] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:13.849 [2024-04-26 00:49:20.790833] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:13.849 [2024-04-26 00:49:20.790839] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:13.849 [2024-04-26 00:49:20.790844] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:13.849 [2024-04-26 00:49:20.790886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:13.849 [2024-04-26 00:49:20.790979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:13.849 [2024-04-26 00:49:20.791061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:13.849 [2024-04-26 00:49:20.791063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:14.419 00:49:21 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:14.419 00:49:21 -- common/autotest_common.sh@850 -- # return 0 00:15:14.419 00:49:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:14.419 00:49:21 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:14.419 00:49:21 -- common/autotest_common.sh@10 -- # set +x 00:15:14.419 00:49:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:14.419 00:49:21 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:15:14.419 00:49:21 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode2500 00:15:14.679 [2024-04-26 00:49:21.633362] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:15:14.679 00:49:21 -- target/invalid.sh@40 -- # out='request: 00:15:14.679 { 00:15:14.679 "nqn": "nqn.2016-06.io.spdk:cnode2500", 00:15:14.679 "tgt_name": "foobar", 00:15:14.679 "method": "nvmf_create_subsystem", 00:15:14.679 "req_id": 1 00:15:14.679 } 00:15:14.679 Got JSON-RPC error response 00:15:14.679 response: 00:15:14.679 { 00:15:14.679 "code": -32603, 00:15:14.679 "message": "Unable to find target foobar" 00:15:14.679 }' 00:15:14.679 00:49:21 -- target/invalid.sh@41 -- # [[ request: 00:15:14.679 { 00:15:14.679 "nqn": "nqn.2016-06.io.spdk:cnode2500", 00:15:14.679 "tgt_name": "foobar", 00:15:14.679 "method": "nvmf_create_subsystem", 00:15:14.679 "req_id": 1 00:15:14.679 } 00:15:14.679 Got JSON-RPC error response 00:15:14.679 response: 00:15:14.679 { 00:15:14.679 "code": -32603, 00:15:14.679 "message": "Unable to find target foobar" 00:15:14.679 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:15:14.679 00:49:21 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:15:14.679 00:49:21 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode240 00:15:14.679 [2024-04-26 00:49:21.809987] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode240: invalid serial number 'SPDKISFASTANDAWESOME' 00:15:14.679 00:49:21 -- target/invalid.sh@45 -- # out='request: 00:15:14.679 { 00:15:14.679 "nqn": "nqn.2016-06.io.spdk:cnode240", 00:15:14.679 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:15:14.679 "method": "nvmf_create_subsystem", 00:15:14.679 "req_id": 1 00:15:14.679 } 00:15:14.679 Got JSON-RPC error response 00:15:14.679 response: 00:15:14.679 { 00:15:14.679 "code": -32602, 00:15:14.679 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:15:14.679 }' 00:15:14.679 00:49:21 -- target/invalid.sh@46 -- # [[ request: 00:15:14.679 { 00:15:14.679 "nqn": "nqn.2016-06.io.spdk:cnode240", 00:15:14.679 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:15:14.679 "method": "nvmf_create_subsystem", 00:15:14.679 "req_id": 1 00:15:14.679 } 00:15:14.679 Got JSON-RPC error response 00:15:14.679 response: 00:15:14.679 { 00:15:14.679 "code": -32602, 00:15:14.679 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:15:14.679 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:15:14.679 00:49:21 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:15:14.679 00:49:21 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode26648 00:15:14.938 [2024-04-26 00:49:21.990501] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26648: invalid model number 'SPDK_Controller' 00:15:14.938 00:49:22 -- target/invalid.sh@50 -- # out='request: 00:15:14.938 { 00:15:14.938 "nqn": "nqn.2016-06.io.spdk:cnode26648", 00:15:14.938 "model_number": "SPDK_Controller\u001f", 00:15:14.938 "method": "nvmf_create_subsystem", 00:15:14.938 "req_id": 1 00:15:14.938 } 00:15:14.938 Got JSON-RPC error response 00:15:14.938 response: 00:15:14.938 { 00:15:14.938 "code": -32602, 00:15:14.938 "message": "Invalid MN SPDK_Controller\u001f" 00:15:14.938 }' 00:15:14.938 00:49:22 -- target/invalid.sh@51 -- # [[ request: 00:15:14.938 { 00:15:14.938 "nqn": "nqn.2016-06.io.spdk:cnode26648", 00:15:14.938 "model_number": "SPDK_Controller\u001f", 00:15:14.938 "method": "nvmf_create_subsystem", 00:15:14.938 "req_id": 1 00:15:14.938 } 00:15:14.938 Got JSON-RPC error response 00:15:14.938 response: 00:15:14.938 { 00:15:14.938 "code": -32602, 00:15:14.938 "message": "Invalid MN SPDK_Controller\u001f" 00:15:14.938 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:15:14.938 00:49:22 -- target/invalid.sh@54 -- # gen_random_s 21 00:15:14.938 00:49:22 -- target/invalid.sh@19 -- # local length=21 ll 00:15:14.938 00:49:22 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:15:14.938 00:49:22 -- target/invalid.sh@21 -- # local chars 00:15:14.938 00:49:22 -- target/invalid.sh@22 -- # local string 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 60 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+='<' 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 86 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x56' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=V 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 88 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x58' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=X 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 119 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x77' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=w 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 75 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=K 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 115 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x73' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=s 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 92 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+='\' 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 52 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x34' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=4 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 67 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x43' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=C 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 52 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x34' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=4 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 74 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=J 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 57 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x39' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=9 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 41 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x29' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=')' 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 32 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x20' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=' ' 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 37 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x25' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=% 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 52 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x34' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=4 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # printf %x 102 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x66' 00:15:14.939 00:49:22 -- target/invalid.sh@25 -- # string+=f 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:14.939 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # printf %x 115 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x73' 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # string+=s 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # printf %x 119 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x77' 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # string+=w 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # printf %x 38 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x26' 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # string+='&' 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # printf %x 124 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:15:15.199 00:49:22 -- target/invalid.sh@25 -- # string+='|' 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll++ )) 00:15:15.199 00:49:22 -- target/invalid.sh@24 -- # (( ll < length )) 00:15:15.199 00:49:22 -- target/invalid.sh@28 -- # [[ < == \- ]] 00:15:15.199 00:49:22 -- target/invalid.sh@31 -- # echo ' /dev/null' 00:15:17.803 00:49:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:17.803 00:49:24 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:17.803 00:49:24 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:17.803 00:49:24 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:17.803 00:49:24 -- common/autotest_common.sh@10 -- # set +x 00:15:23.087 00:49:29 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:23.087 00:49:29 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:23.087 00:49:29 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:23.087 00:49:29 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:23.087 00:49:29 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:23.087 00:49:29 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:23.087 00:49:29 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:23.087 00:49:29 -- nvmf/common.sh@295 -- # net_devs=() 00:15:23.087 00:49:29 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:23.087 00:49:29 -- nvmf/common.sh@296 -- # e810=() 00:15:23.087 00:49:29 -- nvmf/common.sh@296 -- # local -ga e810 00:15:23.087 00:49:29 -- nvmf/common.sh@297 -- # x722=() 00:15:23.087 00:49:29 -- nvmf/common.sh@297 -- # local -ga x722 00:15:23.087 00:49:29 -- nvmf/common.sh@298 -- # mlx=() 00:15:23.087 00:49:29 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:23.087 00:49:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:23.087 00:49:29 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:23.087 00:49:29 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:23.087 00:49:29 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:23.087 00:49:29 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:23.087 00:49:29 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:23.087 00:49:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:23.087 00:49:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:23.087 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:23.087 00:49:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:23.087 00:49:29 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:23.087 00:49:29 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:23.087 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:23.087 00:49:29 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:23.087 00:49:29 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:23.088 00:49:29 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:23.088 00:49:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:23.088 00:49:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:23.088 Found net devices under 0000:18:00.0: mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:23.088 00:49:29 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:23.088 00:49:29 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:23.088 00:49:29 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:23.088 Found net devices under 0000:18:00.1: mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:23.088 00:49:29 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:23.088 00:49:29 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:23.088 00:49:29 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:23.088 00:49:29 -- nvmf/common.sh@58 -- # uname 00:15:23.088 00:49:29 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:23.088 00:49:29 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:23.088 00:49:29 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:23.088 00:49:29 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:23.088 00:49:29 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:23.088 00:49:29 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:23.088 00:49:29 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:23.088 00:49:29 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:23.088 00:49:29 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:23.088 00:49:29 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:23.088 00:49:29 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:23.088 00:49:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:23.088 00:49:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:23.088 00:49:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:23.088 00:49:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:23.088 00:49:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@105 -- # continue 2 00:15:23.088 00:49:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@105 -- # continue 2 00:15:23.088 00:49:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:23.088 00:49:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:23.088 00:49:29 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:23.088 00:49:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:23.088 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:23.088 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:23.088 altname enp24s0f0np0 00:15:23.088 altname ens785f0np0 00:15:23.088 inet 192.168.100.8/24 scope global mlx_0_0 00:15:23.088 valid_lft forever preferred_lft forever 00:15:23.088 00:49:29 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:23.088 00:49:29 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:23.088 00:49:29 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:23.088 00:49:29 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:23.088 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:23.088 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:23.088 altname enp24s0f1np1 00:15:23.088 altname ens785f1np1 00:15:23.088 inet 192.168.100.9/24 scope global mlx_0_1 00:15:23.088 valid_lft forever preferred_lft forever 00:15:23.088 00:49:29 -- nvmf/common.sh@411 -- # return 0 00:15:23.088 00:49:29 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:23.088 00:49:29 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:23.088 00:49:29 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:23.088 00:49:29 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:23.088 00:49:29 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:23.088 00:49:29 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:23.088 00:49:29 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:23.088 00:49:29 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:23.088 00:49:29 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:23.088 00:49:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@105 -- # continue 2 00:15:23.088 00:49:29 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:23.088 00:49:29 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:23.088 00:49:29 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@105 -- # continue 2 00:15:23.088 00:49:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:23.088 00:49:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:23.088 00:49:29 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:23.088 00:49:29 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:23.088 00:49:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:23.088 00:49:29 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:23.088 192.168.100.9' 00:15:23.088 00:49:29 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:23.088 192.168.100.9' 00:15:23.088 00:49:29 -- nvmf/common.sh@446 -- # head -n 1 00:15:23.088 00:49:29 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:23.088 00:49:29 -- nvmf/common.sh@447 -- # tail -n +2 00:15:23.088 00:49:29 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:23.088 192.168.100.9' 00:15:23.088 00:49:29 -- nvmf/common.sh@447 -- # head -n 1 00:15:23.088 00:49:29 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:23.088 00:49:29 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:23.088 00:49:29 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:23.088 00:49:29 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:23.088 00:49:29 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:23.088 00:49:29 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:23.088 00:49:29 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:15:23.088 00:49:29 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:23.088 00:49:29 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:23.088 00:49:29 -- common/autotest_common.sh@10 -- # set +x 00:15:23.088 00:49:29 -- nvmf/common.sh@470 -- # nvmfpid=259973 00:15:23.088 00:49:29 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:23.088 00:49:29 -- nvmf/common.sh@471 -- # waitforlisten 259973 00:15:23.088 00:49:29 -- common/autotest_common.sh@817 -- # '[' -z 259973 ']' 00:15:23.088 00:49:29 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:23.088 00:49:29 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:23.088 00:49:29 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:23.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:23.088 00:49:29 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:23.088 00:49:29 -- common/autotest_common.sh@10 -- # set +x 00:15:23.088 [2024-04-26 00:49:29.668304] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:15:23.088 [2024-04-26 00:49:29.668348] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:23.088 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.088 [2024-04-26 00:49:29.718686] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:23.088 [2024-04-26 00:49:29.783365] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.088 [2024-04-26 00:49:29.783406] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.088 [2024-04-26 00:49:29.783412] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:23.089 [2024-04-26 00:49:29.783417] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:23.089 [2024-04-26 00:49:29.783421] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.089 [2024-04-26 00:49:29.783531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:23.089 [2024-04-26 00:49:29.783618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:23.089 [2024-04-26 00:49:29.783619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:23.347 00:49:30 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:23.347 00:49:30 -- common/autotest_common.sh@850 -- # return 0 00:15:23.347 00:49:30 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:23.347 00:49:30 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:23.347 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.348 00:49:30 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:23.348 00:49:30 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:15:23.348 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.348 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.348 [2024-04-26 00:49:30.505846] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x645080/0x649570) succeed. 00:15:23.348 [2024-04-26 00:49:30.514720] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x646620/0x68ac00) succeed. 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 Malloc0 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 Delay0 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 [2024-04-26 00:49:30.647715] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.607 00:49:30 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:23.607 00:49:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:23.607 00:49:30 -- common/autotest_common.sh@10 -- # set +x 00:15:23.607 00:49:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:23.608 00:49:30 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:15:23.608 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.608 [2024-04-26 00:49:30.730965] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:26.146 Initializing NVMe Controllers 00:15:26.146 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:15:26.146 controller IO queue size 128 less than required 00:15:26.146 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:15:26.146 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:15:26.146 Initialization complete. Launching workers. 00:15:26.146 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 57570 00:15:26.146 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 57631, failed to submit 62 00:15:26.146 success 57571, unsuccess 60, failed 0 00:15:26.146 00:49:32 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:26.146 00:49:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:15:26.146 00:49:32 -- common/autotest_common.sh@10 -- # set +x 00:15:26.146 00:49:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:15:26.146 00:49:32 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:15:26.146 00:49:32 -- target/abort.sh@38 -- # nvmftestfini 00:15:26.146 00:49:32 -- nvmf/common.sh@477 -- # nvmfcleanup 00:15:26.146 00:49:32 -- nvmf/common.sh@117 -- # sync 00:15:26.146 00:49:32 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:15:26.146 00:49:32 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:15:26.146 00:49:32 -- nvmf/common.sh@120 -- # set +e 00:15:26.146 00:49:32 -- nvmf/common.sh@121 -- # for i in {1..20} 00:15:26.146 00:49:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:15:26.146 rmmod nvme_rdma 00:15:26.146 rmmod nvme_fabrics 00:15:26.146 00:49:32 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:15:26.146 00:49:32 -- nvmf/common.sh@124 -- # set -e 00:15:26.146 00:49:32 -- nvmf/common.sh@125 -- # return 0 00:15:26.146 00:49:32 -- nvmf/common.sh@478 -- # '[' -n 259973 ']' 00:15:26.146 00:49:32 -- nvmf/common.sh@479 -- # killprocess 259973 00:15:26.146 00:49:32 -- common/autotest_common.sh@936 -- # '[' -z 259973 ']' 00:15:26.146 00:49:32 -- common/autotest_common.sh@940 -- # kill -0 259973 00:15:26.146 00:49:32 -- common/autotest_common.sh@941 -- # uname 00:15:26.146 00:49:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:26.146 00:49:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 259973 00:15:26.146 00:49:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:26.146 00:49:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:26.146 00:49:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 259973' 00:15:26.146 killing process with pid 259973 00:15:26.146 00:49:32 -- common/autotest_common.sh@955 -- # kill 259973 00:15:26.146 00:49:32 -- common/autotest_common.sh@960 -- # wait 259973 00:15:26.146 [2024-04-26 00:49:32.999654] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:15:26.146 00:49:33 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:15:26.146 00:49:33 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:15:26.146 00:15:26.146 real 0m8.364s 00:15:26.146 user 0m13.508s 00:15:26.146 sys 0m3.886s 00:15:26.146 00:49:33 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:15:26.146 00:49:33 -- common/autotest_common.sh@10 -- # set +x 00:15:26.146 ************************************ 00:15:26.146 END TEST nvmf_abort 00:15:26.146 ************************************ 00:15:26.146 00:49:33 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:15:26.146 00:49:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:26.146 00:49:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:26.146 00:49:33 -- common/autotest_common.sh@10 -- # set +x 00:15:26.407 ************************************ 00:15:26.407 START TEST nvmf_ns_hotplug_stress 00:15:26.407 ************************************ 00:15:26.407 00:49:33 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:15:26.407 * Looking for test storage... 00:15:26.407 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:15:26.407 00:49:33 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:15:26.407 00:49:33 -- nvmf/common.sh@7 -- # uname -s 00:15:26.407 00:49:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:26.407 00:49:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:26.407 00:49:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:26.407 00:49:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:26.407 00:49:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:26.407 00:49:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:26.407 00:49:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:26.407 00:49:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:26.407 00:49:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:26.407 00:49:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:26.407 00:49:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:15:26.407 00:49:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:15:26.407 00:49:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:26.407 00:49:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:26.407 00:49:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:26.407 00:49:33 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:26.407 00:49:33 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:15:26.407 00:49:33 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:26.407 00:49:33 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:26.407 00:49:33 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:26.407 00:49:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.407 00:49:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.407 00:49:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.407 00:49:33 -- paths/export.sh@5 -- # export PATH 00:15:26.407 00:49:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:26.407 00:49:33 -- nvmf/common.sh@47 -- # : 0 00:15:26.407 00:49:33 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:15:26.407 00:49:33 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:15:26.407 00:49:33 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:26.407 00:49:33 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:26.407 00:49:33 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:26.407 00:49:33 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:15:26.407 00:49:33 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:15:26.407 00:49:33 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:15:26.407 00:49:33 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:15:26.407 00:49:33 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:15:26.407 00:49:33 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:15:26.407 00:49:33 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:26.407 00:49:33 -- nvmf/common.sh@437 -- # prepare_net_devs 00:15:26.407 00:49:33 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:15:26.407 00:49:33 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:15:26.407 00:49:33 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.407 00:49:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.407 00:49:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:26.407 00:49:33 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:15:26.407 00:49:33 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:15:26.407 00:49:33 -- nvmf/common.sh@285 -- # xtrace_disable 00:15:26.407 00:49:33 -- common/autotest_common.sh@10 -- # set +x 00:15:31.691 00:49:38 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:31.691 00:49:38 -- nvmf/common.sh@291 -- # pci_devs=() 00:15:31.691 00:49:38 -- nvmf/common.sh@291 -- # local -a pci_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:15:31.691 00:49:38 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@293 -- # pci_drivers=() 00:15:31.691 00:49:38 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:15:31.691 00:49:38 -- nvmf/common.sh@295 -- # net_devs=() 00:15:31.691 00:49:38 -- nvmf/common.sh@295 -- # local -ga net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@296 -- # e810=() 00:15:31.691 00:49:38 -- nvmf/common.sh@296 -- # local -ga e810 00:15:31.691 00:49:38 -- nvmf/common.sh@297 -- # x722=() 00:15:31.691 00:49:38 -- nvmf/common.sh@297 -- # local -ga x722 00:15:31.691 00:49:38 -- nvmf/common.sh@298 -- # mlx=() 00:15:31.691 00:49:38 -- nvmf/common.sh@298 -- # local -ga mlx 00:15:31.691 00:49:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:31.691 00:49:38 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:15:31.691 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:15:31.691 00:49:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:31.691 00:49:38 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:15:31.691 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:15:31.691 00:49:38 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:15:31.691 00:49:38 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:31.691 00:49:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:31.691 00:49:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:15:31.691 Found net devices under 0000:18:00.0: mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:31.691 00:49:38 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:31.691 00:49:38 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:15:31.691 Found net devices under 0000:18:00.1: mlx_0_1 00:15:31.691 00:49:38 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:15:31.691 00:49:38 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@403 -- # is_hw=yes 00:15:31.691 00:49:38 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@409 -- # rdma_device_init 00:15:31.691 00:49:38 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:15:31.691 00:49:38 -- nvmf/common.sh@58 -- # uname 00:15:31.691 00:49:38 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:15:31.691 00:49:38 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:15:31.691 00:49:38 -- nvmf/common.sh@63 -- # modprobe ib_core 00:15:31.691 00:49:38 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:15:31.691 00:49:38 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:15:31.691 00:49:38 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:15:31.691 00:49:38 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:15:31.691 00:49:38 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:15:31.691 00:49:38 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:15:31.691 00:49:38 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:15:31.691 00:49:38 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:15:31.691 00:49:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:31.691 00:49:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:31.691 00:49:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@105 -- # continue 2 00:15:31.691 00:49:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:31.691 00:49:38 -- nvmf/common.sh@105 -- # continue 2 00:15:31.691 00:49:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:31.691 00:49:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:31.691 00:49:38 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:15:31.691 00:49:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:15:31.691 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:31.691 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:15:31.691 altname enp24s0f0np0 00:15:31.691 altname ens785f0np0 00:15:31.691 inet 192.168.100.8/24 scope global mlx_0_0 00:15:31.691 valid_lft forever preferred_lft forever 00:15:31.691 00:49:38 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:15:31.691 00:49:38 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:15:31.691 00:49:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:31.691 00:49:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:31.691 00:49:38 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:15:31.691 00:49:38 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:15:31.691 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:15:31.691 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:15:31.691 altname enp24s0f1np1 00:15:31.691 altname ens785f1np1 00:15:31.691 inet 192.168.100.9/24 scope global mlx_0_1 00:15:31.691 valid_lft forever preferred_lft forever 00:15:31.691 00:49:38 -- nvmf/common.sh@411 -- # return 0 00:15:31.691 00:49:38 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:15:31.691 00:49:38 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:15:31.691 00:49:38 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:15:31.691 00:49:38 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:15:31.691 00:49:38 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:15:31.691 00:49:38 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:15:31.691 00:49:38 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:15:31.691 00:49:38 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:15:31.691 00:49:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:15:31.691 00:49:38 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:15:31.691 00:49:38 -- nvmf/common.sh@105 -- # continue 2 00:15:31.691 00:49:38 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.691 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:15:31.692 00:49:38 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:15:31.692 00:49:38 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:15:31.692 00:49:38 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:15:31.692 00:49:38 -- nvmf/common.sh@105 -- # continue 2 00:15:31.692 00:49:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:31.692 00:49:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:15:31.692 00:49:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:31.692 00:49:38 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:15:31.692 00:49:38 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:15:31.692 00:49:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:31.692 00:49:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:31.692 00:49:38 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:15:31.692 192.168.100.9' 00:15:31.692 00:49:38 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:15:31.692 192.168.100.9' 00:15:31.692 00:49:38 -- nvmf/common.sh@446 -- # head -n 1 00:15:31.692 00:49:38 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:15:31.692 00:49:38 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:15:31.692 192.168.100.9' 00:15:31.692 00:49:38 -- nvmf/common.sh@447 -- # tail -n +2 00:15:31.692 00:49:38 -- nvmf/common.sh@447 -- # head -n 1 00:15:31.692 00:49:38 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:15:31.692 00:49:38 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:15:31.692 00:49:38 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:15:31.692 00:49:38 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:15:31.692 00:49:38 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:15:31.692 00:49:38 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:15:31.692 00:49:38 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:15:31.692 00:49:38 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:15:31.692 00:49:38 -- common/autotest_common.sh@710 -- # xtrace_disable 00:15:31.692 00:49:38 -- common/autotest_common.sh@10 -- # set +x 00:15:31.692 00:49:38 -- nvmf/common.sh@470 -- # nvmfpid=263763 00:15:31.692 00:49:38 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:15:31.692 00:49:38 -- nvmf/common.sh@471 -- # waitforlisten 263763 00:15:31.692 00:49:38 -- common/autotest_common.sh@817 -- # '[' -z 263763 ']' 00:15:31.692 00:49:38 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:31.692 00:49:38 -- common/autotest_common.sh@822 -- # local max_retries=100 00:15:31.692 00:49:38 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:31.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:31.692 00:49:38 -- common/autotest_common.sh@826 -- # xtrace_disable 00:15:31.692 00:49:38 -- common/autotest_common.sh@10 -- # set +x 00:15:31.692 [2024-04-26 00:49:38.496543] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:15:31.692 [2024-04-26 00:49:38.496585] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:31.692 EAL: No free 2048 kB hugepages reported on node 1 00:15:31.692 [2024-04-26 00:49:38.544397] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:31.692 [2024-04-26 00:49:38.613057] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:31.692 [2024-04-26 00:49:38.613097] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:31.692 [2024-04-26 00:49:38.613103] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:31.692 [2024-04-26 00:49:38.613111] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:31.692 [2024-04-26 00:49:38.613115] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:31.692 [2024-04-26 00:49:38.613227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:31.692 [2024-04-26 00:49:38.613330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:31.692 [2024-04-26 00:49:38.613332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:32.261 00:49:39 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:15:32.261 00:49:39 -- common/autotest_common.sh@850 -- # return 0 00:15:32.261 00:49:39 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:15:32.261 00:49:39 -- common/autotest_common.sh@716 -- # xtrace_disable 00:15:32.261 00:49:39 -- common/autotest_common.sh@10 -- # set +x 00:15:32.261 00:49:39 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:32.261 00:49:39 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:15:32.261 00:49:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:15:32.520 [2024-04-26 00:49:39.490690] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x22e3080/0x22e7570) succeed. 00:15:32.520 [2024-04-26 00:49:39.499778] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x22e4620/0x2328c00) succeed. 00:15:32.520 00:49:39 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:32.780 00:49:39 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:15:32.781 [2024-04-26 00:49:39.914006] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:32.781 00:49:39 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:15:33.041 00:49:40 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:15:33.302 Malloc0 00:15:33.302 00:49:40 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:33.302 Delay0 00:15:33.302 00:49:40 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:33.563 00:49:40 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:15:33.823 NULL1 00:15:33.823 00:49:40 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:33.823 00:49:40 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=264315 00:15:33.823 00:49:40 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:15:33.823 00:49:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:33.823 00:49:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:33.823 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.206 Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 00:49:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:35.206 00:49:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:15:35.206 00:49:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:15:35.467 true 00:15:35.467 00:49:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:35.467 00:49:42 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 00:49:43 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:36.406 00:49:43 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:15:36.406 00:49:43 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:15:36.665 true 00:15:36.665 00:49:43 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:36.665 00:49:43 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 00:49:44 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:37.605 00:49:44 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:15:37.605 00:49:44 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:15:37.605 true 00:15:37.866 00:49:44 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:37.866 00:49:44 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 00:49:45 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:38.807 00:49:45 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:15:38.807 00:49:45 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:15:38.807 true 00:15:38.807 00:49:45 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:38.807 00:49:45 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.749 00:49:46 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:39.749 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.010 00:49:46 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:15:40.010 00:49:46 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:15:40.010 true 00:15:40.010 00:49:47 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:40.010 00:49:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 00:49:47 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:40.952 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:41.213 00:49:48 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:15:41.213 00:49:48 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:15:41.213 true 00:15:41.213 00:49:48 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:41.213 00:49:48 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:42.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:42.154 00:49:49 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:42.154 00:49:49 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:15:42.154 00:49:49 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:15:42.415 true 00:15:42.415 00:49:49 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:42.415 00:49:49 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 00:49:50 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:43.356 00:49:50 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:15:43.356 00:49:50 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:15:43.616 true 00:15:43.616 00:49:50 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:43.616 00:49:50 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 00:49:51 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:44.557 00:49:51 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:15:44.557 00:49:51 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:15:44.817 true 00:15:44.817 00:49:51 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:44.817 00:49:51 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 00:49:52 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:45.756 00:49:52 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:15:45.756 00:49:52 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:15:46.015 true 00:15:46.015 00:49:52 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:46.015 00:49:52 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 00:49:53 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:46.954 00:49:54 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:15:46.954 00:49:54 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:15:47.213 true 00:15:47.213 00:49:54 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:47.214 00:49:54 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 00:49:55 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:48.154 00:49:55 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:15:48.154 00:49:55 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:15:48.154 true 00:15:48.414 00:49:55 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:48.414 00:49:55 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:49.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:49.354 00:49:56 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:49.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:49.354 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:49.354 00:49:56 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:15:49.354 00:49:56 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:15:49.354 true 00:15:49.614 00:49:56 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:49.614 00:49:56 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 00:49:57 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:50.555 00:49:57 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:15:50.555 00:49:57 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:15:50.555 true 00:15:50.555 00:49:57 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:50.555 00:49:57 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.496 00:49:58 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:51.756 00:49:58 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:15:51.756 00:49:58 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:15:51.756 true 00:15:51.756 00:49:58 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:51.756 00:49:58 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 00:49:59 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:52.697 00:49:59 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:15:52.957 00:49:59 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:15:52.957 true 00:15:52.957 00:50:00 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:52.957 00:50:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 00:50:00 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:53.897 00:50:01 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:15:53.897 00:50:01 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:15:54.157 true 00:15:54.157 00:50:01 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:54.157 00:50:01 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 00:50:02 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:55.097 00:50:02 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:15:55.097 00:50:02 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:15:55.358 true 00:15:55.358 00:50:02 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:55.358 00:50:02 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:56.296 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:56.296 00:50:03 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:56.296 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:56.296 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:56.296 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:56.296 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:56.296 00:50:03 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:15:56.296 00:50:03 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:15:56.555 true 00:15:56.555 00:50:03 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:56.555 00:50:03 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 00:50:04 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:57.496 00:50:04 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:15:57.496 00:50:04 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:15:57.757 true 00:15:57.757 00:50:04 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:57.757 00:50:04 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 00:50:05 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:58.698 00:50:05 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:15:58.698 00:50:05 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:15:58.958 true 00:15:58.958 00:50:06 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:15:58.958 00:50:06 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 00:50:06 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:15:59.899 00:50:07 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:15:59.899 00:50:07 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:16:00.170 true 00:16:00.170 00:50:07 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:00.170 00:50:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 00:50:08 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:01.112 00:50:08 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:16:01.112 00:50:08 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:16:01.372 true 00:16:01.372 00:50:08 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:01.373 00:50:08 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 00:50:09 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:02.314 00:50:09 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:16:02.314 00:50:09 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:16:02.580 true 00:16:02.580 00:50:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:02.580 00:50:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:03.522 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:03.522 00:50:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:03.522 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:03.522 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:16:03.522 00:50:10 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:16:03.522 00:50:10 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:16:03.522 true 00:16:03.783 00:50:10 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:03.783 00:50:10 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:04.724 00:50:11 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:04.724 00:50:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:16:04.724 00:50:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:16:04.724 true 00:16:04.724 00:50:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:04.724 00:50:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:04.984 00:50:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:05.244 00:50:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:16:05.244 00:50:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:16:05.244 true 00:16:05.244 00:50:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:05.244 00:50:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:05.504 00:50:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:05.504 00:50:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:16:05.504 00:50:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:16:05.763 true 00:16:05.763 00:50:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:05.763 00:50:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:06.022 00:50:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:06.022 00:50:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:16:06.022 00:50:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:16:06.281 true 00:16:06.282 00:50:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:06.282 00:50:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:06.282 00:50:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:06.541 Initializing NVMe Controllers 00:16:06.541 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:06.541 Controller IO queue size 128, less than required. 00:16:06.541 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:06.541 Controller IO queue size 128, less than required. 00:16:06.541 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:06.541 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:06.541 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:16:06.541 Initialization complete. Launching workers. 00:16:06.541 ======================================================== 00:16:06.541 Latency(us) 00:16:06.541 Device Information : IOPS MiB/s Average min max 00:16:06.541 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5383.21 2.63 21271.37 770.76 1126888.78 00:16:06.541 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 36494.57 17.82 3507.32 1534.77 267946.37 00:16:06.541 ======================================================== 00:16:06.541 Total : 41877.78 20.45 5790.81 770.76 1126888.78 00:16:06.541 00:16:06.541 00:50:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1030 00:16:06.541 00:50:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:16:06.801 true 00:16:06.801 00:50:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 264315 00:16:06.801 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (264315) - No such process 00:16:06.801 00:50:13 -- target/ns_hotplug_stress.sh@44 -- # wait 264315 00:16:06.801 00:50:13 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:06.801 00:50:13 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:16:06.801 00:50:13 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:06.801 00:50:13 -- nvmf/common.sh@117 -- # sync 00:16:06.801 00:50:13 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:06.801 00:50:13 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:06.801 00:50:13 -- nvmf/common.sh@120 -- # set +e 00:16:06.801 00:50:13 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:06.801 00:50:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:06.801 rmmod nvme_rdma 00:16:06.801 rmmod nvme_fabrics 00:16:06.801 00:50:13 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:06.801 00:50:13 -- nvmf/common.sh@124 -- # set -e 00:16:06.801 00:50:13 -- nvmf/common.sh@125 -- # return 0 00:16:06.801 00:50:13 -- nvmf/common.sh@478 -- # '[' -n 263763 ']' 00:16:06.801 00:50:13 -- nvmf/common.sh@479 -- # killprocess 263763 00:16:06.801 00:50:13 -- common/autotest_common.sh@936 -- # '[' -z 263763 ']' 00:16:06.801 00:50:13 -- common/autotest_common.sh@940 -- # kill -0 263763 00:16:06.801 00:50:13 -- common/autotest_common.sh@941 -- # uname 00:16:06.801 00:50:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:06.801 00:50:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 263763 00:16:06.801 00:50:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:06.801 00:50:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:06.801 00:50:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 263763' 00:16:06.801 killing process with pid 263763 00:16:06.801 00:50:13 -- common/autotest_common.sh@955 -- # kill 263763 00:16:06.801 00:50:13 -- common/autotest_common.sh@960 -- # wait 263763 00:16:06.801 [2024-04-26 00:50:13.922046] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:07.061 00:50:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:07.061 00:50:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:07.061 00:16:07.061 real 0m40.732s 00:16:07.061 user 2m33.539s 00:16:07.061 sys 0m6.445s 00:16:07.061 00:50:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:07.061 00:50:14 -- common/autotest_common.sh@10 -- # set +x 00:16:07.061 ************************************ 00:16:07.061 END TEST nvmf_ns_hotplug_stress 00:16:07.061 ************************************ 00:16:07.061 00:50:14 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:16:07.061 00:50:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:07.061 00:50:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:07.061 00:50:14 -- common/autotest_common.sh@10 -- # set +x 00:16:07.320 ************************************ 00:16:07.320 START TEST nvmf_connect_stress 00:16:07.320 ************************************ 00:16:07.320 00:50:14 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:16:07.320 * Looking for test storage... 00:16:07.320 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:07.320 00:50:14 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:07.320 00:50:14 -- nvmf/common.sh@7 -- # uname -s 00:16:07.320 00:50:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:07.320 00:50:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:07.320 00:50:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:07.320 00:50:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:07.320 00:50:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:07.320 00:50:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:07.320 00:50:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:07.320 00:50:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:07.320 00:50:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:07.320 00:50:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:07.320 00:50:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:07.320 00:50:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:07.320 00:50:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:07.320 00:50:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:07.320 00:50:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:07.320 00:50:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:07.320 00:50:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:07.320 00:50:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:07.320 00:50:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:07.320 00:50:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:07.320 00:50:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.320 00:50:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.320 00:50:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.320 00:50:14 -- paths/export.sh@5 -- # export PATH 00:16:07.320 00:50:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.320 00:50:14 -- nvmf/common.sh@47 -- # : 0 00:16:07.320 00:50:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:07.320 00:50:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:07.320 00:50:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:07.320 00:50:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:07.320 00:50:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:07.321 00:50:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:07.321 00:50:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:07.321 00:50:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:07.321 00:50:14 -- target/connect_stress.sh@12 -- # nvmftestinit 00:16:07.321 00:50:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:07.321 00:50:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:07.321 00:50:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:07.321 00:50:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:07.321 00:50:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:07.321 00:50:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:07.321 00:50:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:07.321 00:50:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:07.321 00:50:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:07.321 00:50:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:07.321 00:50:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:07.321 00:50:14 -- common/autotest_common.sh@10 -- # set +x 00:16:12.604 00:50:19 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:12.604 00:50:19 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:12.604 00:50:19 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:12.604 00:50:19 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:12.604 00:50:19 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:12.604 00:50:19 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:12.604 00:50:19 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:12.604 00:50:19 -- nvmf/common.sh@295 -- # net_devs=() 00:16:12.604 00:50:19 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:12.604 00:50:19 -- nvmf/common.sh@296 -- # e810=() 00:16:12.604 00:50:19 -- nvmf/common.sh@296 -- # local -ga e810 00:16:12.604 00:50:19 -- nvmf/common.sh@297 -- # x722=() 00:16:12.604 00:50:19 -- nvmf/common.sh@297 -- # local -ga x722 00:16:12.604 00:50:19 -- nvmf/common.sh@298 -- # mlx=() 00:16:12.604 00:50:19 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:12.604 00:50:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:12.604 00:50:19 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:12.604 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:12.604 00:50:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:12.604 00:50:19 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:12.604 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:12.604 00:50:19 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:12.604 00:50:19 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.604 00:50:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.604 00:50:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:12.604 Found net devices under 0000:18:00.0: mlx_0_0 00:16:12.604 00:50:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:12.604 00:50:19 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:12.604 00:50:19 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:12.604 Found net devices under 0000:18:00.1: mlx_0_1 00:16:12.604 00:50:19 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:12.604 00:50:19 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:12.604 00:50:19 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:12.604 00:50:19 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:12.604 00:50:19 -- nvmf/common.sh@58 -- # uname 00:16:12.604 00:50:19 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:12.604 00:50:19 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:12.604 00:50:19 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:12.604 00:50:19 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:12.604 00:50:19 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:12.604 00:50:19 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:12.604 00:50:19 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:12.604 00:50:19 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:12.604 00:50:19 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:12.604 00:50:19 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:12.604 00:50:19 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:12.604 00:50:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:12.604 00:50:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:12.604 00:50:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:12.604 00:50:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:12.604 00:50:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:12.604 00:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:12.604 00:50:19 -- nvmf/common.sh@105 -- # continue 2 00:16:12.604 00:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.604 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:12.604 00:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:12.604 00:50:19 -- nvmf/common.sh@105 -- # continue 2 00:16:12.604 00:50:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:12.604 00:50:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:12.604 00:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:12.604 00:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:12.604 00:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:12.604 00:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:12.604 00:50:19 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:12.605 00:50:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:12.605 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:12.605 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:12.605 altname enp24s0f0np0 00:16:12.605 altname ens785f0np0 00:16:12.605 inet 192.168.100.8/24 scope global mlx_0_0 00:16:12.605 valid_lft forever preferred_lft forever 00:16:12.605 00:50:19 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:12.605 00:50:19 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:12.605 00:50:19 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:12.605 00:50:19 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:12.605 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:12.605 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:12.605 altname enp24s0f1np1 00:16:12.605 altname ens785f1np1 00:16:12.605 inet 192.168.100.9/24 scope global mlx_0_1 00:16:12.605 valid_lft forever preferred_lft forever 00:16:12.605 00:50:19 -- nvmf/common.sh@411 -- # return 0 00:16:12.605 00:50:19 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:12.605 00:50:19 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:12.605 00:50:19 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:12.605 00:50:19 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:12.605 00:50:19 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:12.605 00:50:19 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:12.605 00:50:19 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:12.605 00:50:19 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:12.605 00:50:19 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:12.605 00:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:12.605 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.605 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:12.605 00:50:19 -- nvmf/common.sh@105 -- # continue 2 00:16:12.605 00:50:19 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:12.605 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.605 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:12.605 00:50:19 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:12.605 00:50:19 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@105 -- # continue 2 00:16:12.605 00:50:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:12.605 00:50:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:12.605 00:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:12.605 00:50:19 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:12.605 00:50:19 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:12.605 00:50:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:12.605 00:50:19 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:12.605 192.168.100.9' 00:16:12.605 00:50:19 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:12.605 192.168.100.9' 00:16:12.605 00:50:19 -- nvmf/common.sh@446 -- # head -n 1 00:16:12.605 00:50:19 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:12.605 00:50:19 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:12.605 192.168.100.9' 00:16:12.605 00:50:19 -- nvmf/common.sh@447 -- # tail -n +2 00:16:12.605 00:50:19 -- nvmf/common.sh@447 -- # head -n 1 00:16:12.605 00:50:19 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:12.605 00:50:19 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:12.605 00:50:19 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:12.605 00:50:19 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:12.605 00:50:19 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:12.605 00:50:19 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:12.605 00:50:19 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:16:12.605 00:50:19 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:12.605 00:50:19 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:12.605 00:50:19 -- common/autotest_common.sh@10 -- # set +x 00:16:12.605 00:50:19 -- nvmf/common.sh@470 -- # nvmfpid=273408 00:16:12.605 00:50:19 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:16:12.605 00:50:19 -- nvmf/common.sh@471 -- # waitforlisten 273408 00:16:12.605 00:50:19 -- common/autotest_common.sh@817 -- # '[' -z 273408 ']' 00:16:12.605 00:50:19 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:12.605 00:50:19 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:12.605 00:50:19 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:12.605 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:12.605 00:50:19 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:12.605 00:50:19 -- common/autotest_common.sh@10 -- # set +x 00:16:12.605 [2024-04-26 00:50:19.386726] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:16:12.605 [2024-04-26 00:50:19.386774] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:12.605 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.605 [2024-04-26 00:50:19.438504] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:12.605 [2024-04-26 00:50:19.504576] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:12.605 [2024-04-26 00:50:19.504617] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:12.605 [2024-04-26 00:50:19.504622] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:12.605 [2024-04-26 00:50:19.504628] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:12.605 [2024-04-26 00:50:19.504632] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:12.605 [2024-04-26 00:50:19.504745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:12.605 [2024-04-26 00:50:19.504845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:12.605 [2024-04-26 00:50:19.504846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:13.177 00:50:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:13.177 00:50:20 -- common/autotest_common.sh@850 -- # return 0 00:16:13.177 00:50:20 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:13.177 00:50:20 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:13.177 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.177 00:50:20 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:13.177 00:50:20 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:13.177 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.177 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.177 [2024-04-26 00:50:20.230620] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1275080/0x1279570) succeed. 00:16:13.177 [2024-04-26 00:50:20.239834] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1276620/0x12bac00) succeed. 00:16:13.177 00:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.177 00:50:20 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:13.177 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.177 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.177 00:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.177 00:50:20 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:13.177 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.177 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.177 [2024-04-26 00:50:20.342886] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:13.177 00:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.177 00:50:20 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:13.177 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.177 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.177 NULL1 00:16:13.177 00:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.177 00:50:20 -- target/connect_stress.sh@21 -- # PERF_PID=273689 00:16:13.177 00:50:20 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:16:13.177 00:50:20 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:16:13.177 00:50:20 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:16:13.177 00:50:20 -- target/connect_stress.sh@27 -- # seq 1 20 00:16:13.177 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.177 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.437 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.437 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.438 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.438 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.438 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.438 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.438 00:50:20 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:16:13.438 00:50:20 -- target/connect_stress.sh@28 -- # cat 00:16:13.438 00:50:20 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:13.438 00:50:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:13.438 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.438 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.698 00:50:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.698 00:50:20 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:13.698 00:50:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:13.698 00:50:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.698 00:50:20 -- common/autotest_common.sh@10 -- # set +x 00:16:13.958 00:50:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:13.958 00:50:21 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:13.958 00:50:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:13.958 00:50:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:13.958 00:50:21 -- common/autotest_common.sh@10 -- # set +x 00:16:14.219 00:50:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.219 00:50:21 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:14.219 00:50:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:14.219 00:50:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.219 00:50:21 -- common/autotest_common.sh@10 -- # set +x 00:16:14.790 00:50:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:14.790 00:50:21 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:14.790 00:50:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:14.790 00:50:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:14.790 00:50:21 -- common/autotest_common.sh@10 -- # set +x 00:16:15.050 00:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:15.050 00:50:22 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:15.050 00:50:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:15.050 00:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:15.050 00:50:22 -- common/autotest_common.sh@10 -- # set +x 00:16:15.310 00:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:15.310 00:50:22 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:15.310 00:50:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:15.310 00:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:15.310 00:50:22 -- common/autotest_common.sh@10 -- # set +x 00:16:15.570 00:50:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:15.570 00:50:22 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:15.570 00:50:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:15.570 00:50:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:15.570 00:50:22 -- common/autotest_common.sh@10 -- # set +x 00:16:15.829 00:50:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:15.829 00:50:23 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:16.088 00:50:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:16.088 00:50:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:16.088 00:50:23 -- common/autotest_common.sh@10 -- # set +x 00:16:16.348 00:50:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:16.348 00:50:23 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:16.348 00:50:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:16.348 00:50:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:16.348 00:50:23 -- common/autotest_common.sh@10 -- # set +x 00:16:16.608 00:50:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:16.608 00:50:23 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:16.608 00:50:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:16.608 00:50:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:16.608 00:50:23 -- common/autotest_common.sh@10 -- # set +x 00:16:16.868 00:50:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:16.868 00:50:23 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:16.868 00:50:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:16.868 00:50:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:16.868 00:50:23 -- common/autotest_common.sh@10 -- # set +x 00:16:17.127 00:50:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:17.127 00:50:24 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:17.127 00:50:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:17.127 00:50:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:17.127 00:50:24 -- common/autotest_common.sh@10 -- # set +x 00:16:17.696 00:50:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:17.696 00:50:24 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:17.696 00:50:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:17.696 00:50:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:17.696 00:50:24 -- common/autotest_common.sh@10 -- # set +x 00:16:17.956 00:50:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:17.956 00:50:24 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:17.956 00:50:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:17.956 00:50:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:17.956 00:50:24 -- common/autotest_common.sh@10 -- # set +x 00:16:18.216 00:50:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.217 00:50:25 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:18.217 00:50:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:18.217 00:50:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.217 00:50:25 -- common/autotest_common.sh@10 -- # set +x 00:16:18.476 00:50:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.476 00:50:25 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:18.476 00:50:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:18.476 00:50:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.476 00:50:25 -- common/autotest_common.sh@10 -- # set +x 00:16:18.736 00:50:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:18.736 00:50:25 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:18.996 00:50:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:18.996 00:50:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:18.996 00:50:25 -- common/autotest_common.sh@10 -- # set +x 00:16:19.257 00:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.257 00:50:26 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:19.257 00:50:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:19.257 00:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.257 00:50:26 -- common/autotest_common.sh@10 -- # set +x 00:16:19.516 00:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.516 00:50:26 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:19.516 00:50:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:19.516 00:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.516 00:50:26 -- common/autotest_common.sh@10 -- # set +x 00:16:19.774 00:50:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:19.774 00:50:26 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:19.774 00:50:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:19.774 00:50:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:19.774 00:50:26 -- common/autotest_common.sh@10 -- # set +x 00:16:20.344 00:50:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:20.344 00:50:27 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:20.344 00:50:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:20.344 00:50:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:20.344 00:50:27 -- common/autotest_common.sh@10 -- # set +x 00:16:20.603 00:50:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:20.603 00:50:27 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:20.603 00:50:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:20.603 00:50:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:20.603 00:50:27 -- common/autotest_common.sh@10 -- # set +x 00:16:20.863 00:50:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:20.863 00:50:27 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:20.863 00:50:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:20.863 00:50:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:20.863 00:50:27 -- common/autotest_common.sh@10 -- # set +x 00:16:21.122 00:50:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:21.122 00:50:28 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:21.122 00:50:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:21.122 00:50:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:21.122 00:50:28 -- common/autotest_common.sh@10 -- # set +x 00:16:21.382 00:50:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:21.382 00:50:28 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:21.382 00:50:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:21.382 00:50:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:21.382 00:50:28 -- common/autotest_common.sh@10 -- # set +x 00:16:21.952 00:50:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:21.952 00:50:28 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:21.952 00:50:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:21.952 00:50:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:21.952 00:50:28 -- common/autotest_common.sh@10 -- # set +x 00:16:22.212 00:50:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:22.212 00:50:29 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:22.212 00:50:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:22.212 00:50:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:22.212 00:50:29 -- common/autotest_common.sh@10 -- # set +x 00:16:22.471 00:50:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:22.472 00:50:29 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:22.472 00:50:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:22.472 00:50:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:22.472 00:50:29 -- common/autotest_common.sh@10 -- # set +x 00:16:22.731 00:50:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:22.732 00:50:29 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:22.732 00:50:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:22.732 00:50:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:22.732 00:50:29 -- common/autotest_common.sh@10 -- # set +x 00:16:22.992 00:50:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:22.992 00:50:30 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:22.992 00:50:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:22.992 00:50:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:22.992 00:50:30 -- common/autotest_common.sh@10 -- # set +x 00:16:23.561 00:50:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.561 00:50:30 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:23.561 00:50:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:16:23.561 00:50:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:23.561 00:50:30 -- common/autotest_common.sh@10 -- # set +x 00:16:23.561 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:23.820 00:50:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:23.820 00:50:30 -- target/connect_stress.sh@34 -- # kill -0 273689 00:16:23.820 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (273689) - No such process 00:16:23.820 00:50:30 -- target/connect_stress.sh@38 -- # wait 273689 00:16:23.820 00:50:30 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:16:23.820 00:50:30 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:23.820 00:50:30 -- target/connect_stress.sh@43 -- # nvmftestfini 00:16:23.820 00:50:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:23.820 00:50:30 -- nvmf/common.sh@117 -- # sync 00:16:23.820 00:50:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:23.820 00:50:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:23.820 00:50:30 -- nvmf/common.sh@120 -- # set +e 00:16:23.820 00:50:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:23.820 00:50:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:23.820 rmmod nvme_rdma 00:16:23.820 rmmod nvme_fabrics 00:16:23.820 00:50:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:23.820 00:50:30 -- nvmf/common.sh@124 -- # set -e 00:16:23.820 00:50:30 -- nvmf/common.sh@125 -- # return 0 00:16:23.820 00:50:30 -- nvmf/common.sh@478 -- # '[' -n 273408 ']' 00:16:23.820 00:50:30 -- nvmf/common.sh@479 -- # killprocess 273408 00:16:23.820 00:50:30 -- common/autotest_common.sh@936 -- # '[' -z 273408 ']' 00:16:23.820 00:50:30 -- common/autotest_common.sh@940 -- # kill -0 273408 00:16:23.820 00:50:30 -- common/autotest_common.sh@941 -- # uname 00:16:23.820 00:50:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:23.820 00:50:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 273408 00:16:23.820 00:50:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:23.820 00:50:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:23.820 00:50:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 273408' 00:16:23.820 killing process with pid 273408 00:16:23.820 00:50:30 -- common/autotest_common.sh@955 -- # kill 273408 00:16:23.820 00:50:30 -- common/autotest_common.sh@960 -- # wait 273408 00:16:23.820 [2024-04-26 00:50:30.928068] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:24.080 00:50:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:24.080 00:50:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:24.080 00:16:24.080 real 0m16.841s 00:16:24.080 user 0m42.095s 00:16:24.080 sys 0m5.510s 00:16:24.080 00:50:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:24.080 00:50:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.080 ************************************ 00:16:24.080 END TEST nvmf_connect_stress 00:16:24.080 ************************************ 00:16:24.080 00:50:31 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:16:24.080 00:50:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:24.080 00:50:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:24.080 00:50:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.340 ************************************ 00:16:24.340 START TEST nvmf_fused_ordering 00:16:24.340 ************************************ 00:16:24.340 00:50:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:16:24.340 * Looking for test storage... 00:16:24.340 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:24.340 00:50:31 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:24.340 00:50:31 -- nvmf/common.sh@7 -- # uname -s 00:16:24.340 00:50:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:24.340 00:50:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:24.340 00:50:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:24.340 00:50:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:24.340 00:50:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:24.340 00:50:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:24.340 00:50:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:24.340 00:50:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:24.340 00:50:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:24.340 00:50:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:24.340 00:50:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:24.340 00:50:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:24.340 00:50:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:24.340 00:50:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:24.340 00:50:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:24.340 00:50:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:24.340 00:50:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:24.340 00:50:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:24.340 00:50:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:24.340 00:50:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:24.340 00:50:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.340 00:50:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.340 00:50:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.340 00:50:31 -- paths/export.sh@5 -- # export PATH 00:16:24.340 00:50:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.340 00:50:31 -- nvmf/common.sh@47 -- # : 0 00:16:24.340 00:50:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:24.340 00:50:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:24.340 00:50:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:24.340 00:50:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:24.340 00:50:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:24.340 00:50:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:24.340 00:50:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:24.341 00:50:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:24.341 00:50:31 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:16:24.341 00:50:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:24.341 00:50:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:24.341 00:50:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:24.341 00:50:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:24.341 00:50:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:24.341 00:50:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.341 00:50:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.341 00:50:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:24.341 00:50:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:24.341 00:50:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:24.341 00:50:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:24.341 00:50:31 -- common/autotest_common.sh@10 -- # set +x 00:16:29.625 00:50:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.625 00:50:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:29.625 00:50:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:29.625 00:50:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:29.625 00:50:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:29.625 00:50:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:29.625 00:50:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:29.625 00:50:36 -- nvmf/common.sh@295 -- # net_devs=() 00:16:29.625 00:50:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:29.625 00:50:36 -- nvmf/common.sh@296 -- # e810=() 00:16:29.625 00:50:36 -- nvmf/common.sh@296 -- # local -ga e810 00:16:29.625 00:50:36 -- nvmf/common.sh@297 -- # x722=() 00:16:29.625 00:50:36 -- nvmf/common.sh@297 -- # local -ga x722 00:16:29.625 00:50:36 -- nvmf/common.sh@298 -- # mlx=() 00:16:29.625 00:50:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:29.625 00:50:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.625 00:50:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:29.625 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:29.625 00:50:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:29.625 00:50:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:29.625 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:29.625 00:50:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:29.625 00:50:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.625 00:50:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.625 00:50:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:29.625 Found net devices under 0000:18:00.0: mlx_0_0 00:16:29.625 00:50:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.625 00:50:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.625 00:50:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:29.625 Found net devices under 0000:18:00.1: mlx_0_1 00:16:29.625 00:50:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.625 00:50:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:29.625 00:50:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:29.625 00:50:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:29.625 00:50:36 -- nvmf/common.sh@58 -- # uname 00:16:29.625 00:50:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:29.625 00:50:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:29.625 00:50:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:29.625 00:50:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:29.625 00:50:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:29.625 00:50:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:29.625 00:50:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:29.625 00:50:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:29.625 00:50:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:29.625 00:50:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:29.625 00:50:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:29.625 00:50:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:29.625 00:50:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:29.625 00:50:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:29.625 00:50:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:29.625 00:50:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:29.625 00:50:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:29.625 00:50:36 -- nvmf/common.sh@105 -- # continue 2 00:16:29.625 00:50:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.625 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:29.625 00:50:36 -- nvmf/common.sh@105 -- # continue 2 00:16:29.625 00:50:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:29.625 00:50:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:29.625 00:50:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:29.625 00:50:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:29.625 00:50:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:29.625 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:29.625 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:29.625 altname enp24s0f0np0 00:16:29.625 altname ens785f0np0 00:16:29.625 inet 192.168.100.8/24 scope global mlx_0_0 00:16:29.625 valid_lft forever preferred_lft forever 00:16:29.625 00:50:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:29.625 00:50:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:29.625 00:50:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:29.625 00:50:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:29.625 00:50:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:29.625 00:50:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:29.625 00:50:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:29.625 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:29.625 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:29.625 altname enp24s0f1np1 00:16:29.626 altname ens785f1np1 00:16:29.626 inet 192.168.100.9/24 scope global mlx_0_1 00:16:29.626 valid_lft forever preferred_lft forever 00:16:29.626 00:50:36 -- nvmf/common.sh@411 -- # return 0 00:16:29.626 00:50:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:29.626 00:50:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:29.626 00:50:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:29.626 00:50:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:29.626 00:50:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:29.626 00:50:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:29.626 00:50:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:29.626 00:50:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:29.626 00:50:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:29.626 00:50:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:29.626 00:50:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:29.626 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.626 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:29.626 00:50:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:29.626 00:50:36 -- nvmf/common.sh@105 -- # continue 2 00:16:29.626 00:50:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:29.626 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.626 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:29.626 00:50:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:29.626 00:50:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:29.626 00:50:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:29.626 00:50:36 -- nvmf/common.sh@105 -- # continue 2 00:16:29.626 00:50:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:29.626 00:50:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:29.626 00:50:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:29.626 00:50:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:29.626 00:50:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:29.626 00:50:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:29.626 00:50:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:29.626 00:50:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:29.626 192.168.100.9' 00:16:29.626 00:50:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:29.626 192.168.100.9' 00:16:29.626 00:50:36 -- nvmf/common.sh@446 -- # head -n 1 00:16:29.626 00:50:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:29.626 00:50:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:29.626 192.168.100.9' 00:16:29.626 00:50:36 -- nvmf/common.sh@447 -- # tail -n +2 00:16:29.626 00:50:36 -- nvmf/common.sh@447 -- # head -n 1 00:16:29.626 00:50:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:29.626 00:50:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:29.626 00:50:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:29.626 00:50:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:29.626 00:50:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:29.626 00:50:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:29.626 00:50:36 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:16:29.626 00:50:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:29.626 00:50:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:29.626 00:50:36 -- common/autotest_common.sh@10 -- # set +x 00:16:29.626 00:50:36 -- nvmf/common.sh@470 -- # nvmfpid=278792 00:16:29.626 00:50:36 -- nvmf/common.sh@471 -- # waitforlisten 278792 00:16:29.626 00:50:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:29.626 00:50:36 -- common/autotest_common.sh@817 -- # '[' -z 278792 ']' 00:16:29.626 00:50:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.626 00:50:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:29.626 00:50:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.626 00:50:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:29.626 00:50:36 -- common/autotest_common.sh@10 -- # set +x 00:16:29.626 [2024-04-26 00:50:36.802251] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:16:29.626 [2024-04-26 00:50:36.802299] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.885 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.885 [2024-04-26 00:50:36.854073] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:29.885 [2024-04-26 00:50:36.926009] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.885 [2024-04-26 00:50:36.926040] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.885 [2024-04-26 00:50:36.926046] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:29.885 [2024-04-26 00:50:36.926052] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:29.885 [2024-04-26 00:50:36.926056] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.885 [2024-04-26 00:50:36.926070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:30.454 00:50:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:30.454 00:50:37 -- common/autotest_common.sh@850 -- # return 0 00:16:30.454 00:50:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:30.454 00:50:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:30.454 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.454 00:50:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:30.454 00:50:37 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:30.454 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.454 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.454 [2024-04-26 00:50:37.609427] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21cea10/0x21d2f00) succeed. 00:16:30.454 [2024-04-26 00:50:37.617931] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21cff10/0x2214590) succeed. 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:30.716 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.716 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:30.716 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.716 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.716 [2024-04-26 00:50:37.674492] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:30.716 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.716 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.716 NULL1 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:16:30.716 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.716 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:16:30.716 00:50:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:30.716 00:50:37 -- common/autotest_common.sh@10 -- # set +x 00:16:30.716 00:50:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:30.716 00:50:37 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:16:30.716 [2024-04-26 00:50:37.726766] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:16:30.716 [2024-04-26 00:50:37.726796] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid279069 ] 00:16:30.716 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.716 Attached to nqn.2016-06.io.spdk:cnode1 00:16:30.716 Namespace ID: 1 size: 1GB 00:16:30.716 fused_ordering(0) 00:16:30.716 fused_ordering(1) 00:16:30.716 fused_ordering(2) 00:16:30.716 fused_ordering(3) 00:16:30.716 fused_ordering(4) 00:16:30.716 fused_ordering(5) 00:16:30.716 fused_ordering(6) 00:16:30.716 fused_ordering(7) 00:16:30.716 fused_ordering(8) 00:16:30.716 fused_ordering(9) 00:16:30.716 fused_ordering(10) 00:16:30.716 fused_ordering(11) 00:16:30.716 fused_ordering(12) 00:16:30.716 fused_ordering(13) 00:16:30.716 fused_ordering(14) 00:16:30.716 fused_ordering(15) 00:16:30.716 fused_ordering(16) 00:16:30.716 fused_ordering(17) 00:16:30.716 fused_ordering(18) 00:16:30.716 fused_ordering(19) 00:16:30.716 fused_ordering(20) 00:16:30.716 fused_ordering(21) 00:16:30.716 fused_ordering(22) 00:16:30.716 fused_ordering(23) 00:16:30.716 fused_ordering(24) 00:16:30.716 fused_ordering(25) 00:16:30.716 fused_ordering(26) 00:16:30.716 fused_ordering(27) 00:16:30.716 fused_ordering(28) 00:16:30.716 fused_ordering(29) 00:16:30.716 fused_ordering(30) 00:16:30.716 fused_ordering(31) 00:16:30.716 fused_ordering(32) 00:16:30.716 fused_ordering(33) 00:16:30.716 fused_ordering(34) 00:16:30.716 fused_ordering(35) 00:16:30.716 fused_ordering(36) 00:16:30.716 fused_ordering(37) 00:16:30.716 fused_ordering(38) 00:16:30.716 fused_ordering(39) 00:16:30.716 fused_ordering(40) 00:16:30.716 fused_ordering(41) 00:16:30.716 fused_ordering(42) 00:16:30.716 fused_ordering(43) 00:16:30.716 fused_ordering(44) 00:16:30.716 fused_ordering(45) 00:16:30.716 fused_ordering(46) 00:16:30.716 fused_ordering(47) 00:16:30.716 fused_ordering(48) 00:16:30.716 fused_ordering(49) 00:16:30.716 fused_ordering(50) 00:16:30.716 fused_ordering(51) 00:16:30.716 fused_ordering(52) 00:16:30.716 fused_ordering(53) 00:16:30.716 fused_ordering(54) 00:16:30.716 fused_ordering(55) 00:16:30.716 fused_ordering(56) 00:16:30.716 fused_ordering(57) 00:16:30.716 fused_ordering(58) 00:16:30.716 fused_ordering(59) 00:16:30.716 fused_ordering(60) 00:16:30.716 fused_ordering(61) 00:16:30.716 fused_ordering(62) 00:16:30.716 fused_ordering(63) 00:16:30.716 fused_ordering(64) 00:16:30.716 fused_ordering(65) 00:16:30.716 fused_ordering(66) 00:16:30.716 fused_ordering(67) 00:16:30.716 fused_ordering(68) 00:16:30.716 fused_ordering(69) 00:16:30.716 fused_ordering(70) 00:16:30.716 fused_ordering(71) 00:16:30.716 fused_ordering(72) 00:16:30.716 fused_ordering(73) 00:16:30.716 fused_ordering(74) 00:16:30.716 fused_ordering(75) 00:16:30.716 fused_ordering(76) 00:16:30.716 fused_ordering(77) 00:16:30.716 fused_ordering(78) 00:16:30.716 fused_ordering(79) 00:16:30.716 fused_ordering(80) 00:16:30.716 fused_ordering(81) 00:16:30.716 fused_ordering(82) 00:16:30.716 fused_ordering(83) 00:16:30.716 fused_ordering(84) 00:16:30.716 fused_ordering(85) 00:16:30.716 fused_ordering(86) 00:16:30.716 fused_ordering(87) 00:16:30.716 fused_ordering(88) 00:16:30.716 fused_ordering(89) 00:16:30.716 fused_ordering(90) 00:16:30.716 fused_ordering(91) 00:16:30.716 fused_ordering(92) 00:16:30.716 fused_ordering(93) 00:16:30.716 fused_ordering(94) 00:16:30.716 fused_ordering(95) 00:16:30.716 fused_ordering(96) 00:16:30.716 fused_ordering(97) 00:16:30.716 fused_ordering(98) 00:16:30.716 fused_ordering(99) 00:16:30.716 fused_ordering(100) 00:16:30.716 fused_ordering(101) 00:16:30.716 fused_ordering(102) 00:16:30.716 fused_ordering(103) 00:16:30.716 fused_ordering(104) 00:16:30.716 fused_ordering(105) 00:16:30.716 fused_ordering(106) 00:16:30.716 fused_ordering(107) 00:16:30.716 fused_ordering(108) 00:16:30.716 fused_ordering(109) 00:16:30.716 fused_ordering(110) 00:16:30.716 fused_ordering(111) 00:16:30.716 fused_ordering(112) 00:16:30.716 fused_ordering(113) 00:16:30.716 fused_ordering(114) 00:16:30.716 fused_ordering(115) 00:16:30.716 fused_ordering(116) 00:16:30.716 fused_ordering(117) 00:16:30.716 fused_ordering(118) 00:16:30.716 fused_ordering(119) 00:16:30.716 fused_ordering(120) 00:16:30.716 fused_ordering(121) 00:16:30.716 fused_ordering(122) 00:16:30.716 fused_ordering(123) 00:16:30.716 fused_ordering(124) 00:16:30.716 fused_ordering(125) 00:16:30.716 fused_ordering(126) 00:16:30.716 fused_ordering(127) 00:16:30.716 fused_ordering(128) 00:16:30.716 fused_ordering(129) 00:16:30.716 fused_ordering(130) 00:16:30.716 fused_ordering(131) 00:16:30.716 fused_ordering(132) 00:16:30.716 fused_ordering(133) 00:16:30.716 fused_ordering(134) 00:16:30.716 fused_ordering(135) 00:16:30.716 fused_ordering(136) 00:16:30.716 fused_ordering(137) 00:16:30.716 fused_ordering(138) 00:16:30.716 fused_ordering(139) 00:16:30.716 fused_ordering(140) 00:16:30.716 fused_ordering(141) 00:16:30.716 fused_ordering(142) 00:16:30.716 fused_ordering(143) 00:16:30.716 fused_ordering(144) 00:16:30.716 fused_ordering(145) 00:16:30.716 fused_ordering(146) 00:16:30.716 fused_ordering(147) 00:16:30.716 fused_ordering(148) 00:16:30.716 fused_ordering(149) 00:16:30.716 fused_ordering(150) 00:16:30.716 fused_ordering(151) 00:16:30.716 fused_ordering(152) 00:16:30.716 fused_ordering(153) 00:16:30.716 fused_ordering(154) 00:16:30.716 fused_ordering(155) 00:16:30.716 fused_ordering(156) 00:16:30.716 fused_ordering(157) 00:16:30.716 fused_ordering(158) 00:16:30.717 fused_ordering(159) 00:16:30.717 fused_ordering(160) 00:16:30.717 fused_ordering(161) 00:16:30.717 fused_ordering(162) 00:16:30.717 fused_ordering(163) 00:16:30.717 fused_ordering(164) 00:16:30.717 fused_ordering(165) 00:16:30.717 fused_ordering(166) 00:16:30.717 fused_ordering(167) 00:16:30.717 fused_ordering(168) 00:16:30.717 fused_ordering(169) 00:16:30.717 fused_ordering(170) 00:16:30.717 fused_ordering(171) 00:16:30.717 fused_ordering(172) 00:16:30.717 fused_ordering(173) 00:16:30.717 fused_ordering(174) 00:16:30.717 fused_ordering(175) 00:16:30.717 fused_ordering(176) 00:16:30.717 fused_ordering(177) 00:16:30.717 fused_ordering(178) 00:16:30.717 fused_ordering(179) 00:16:30.717 fused_ordering(180) 00:16:30.717 fused_ordering(181) 00:16:30.717 fused_ordering(182) 00:16:30.717 fused_ordering(183) 00:16:30.717 fused_ordering(184) 00:16:30.717 fused_ordering(185) 00:16:30.717 fused_ordering(186) 00:16:30.717 fused_ordering(187) 00:16:30.717 fused_ordering(188) 00:16:30.717 fused_ordering(189) 00:16:30.717 fused_ordering(190) 00:16:30.717 fused_ordering(191) 00:16:30.717 fused_ordering(192) 00:16:30.717 fused_ordering(193) 00:16:30.717 fused_ordering(194) 00:16:30.717 fused_ordering(195) 00:16:30.717 fused_ordering(196) 00:16:30.717 fused_ordering(197) 00:16:30.717 fused_ordering(198) 00:16:30.717 fused_ordering(199) 00:16:30.717 fused_ordering(200) 00:16:30.717 fused_ordering(201) 00:16:30.717 fused_ordering(202) 00:16:30.717 fused_ordering(203) 00:16:30.717 fused_ordering(204) 00:16:30.717 fused_ordering(205) 00:16:30.978 fused_ordering(206) 00:16:30.978 fused_ordering(207) 00:16:30.978 fused_ordering(208) 00:16:30.978 fused_ordering(209) 00:16:30.978 fused_ordering(210) 00:16:30.978 fused_ordering(211) 00:16:30.978 fused_ordering(212) 00:16:30.978 fused_ordering(213) 00:16:30.978 fused_ordering(214) 00:16:30.978 fused_ordering(215) 00:16:30.978 fused_ordering(216) 00:16:30.978 fused_ordering(217) 00:16:30.978 fused_ordering(218) 00:16:30.978 fused_ordering(219) 00:16:30.978 fused_ordering(220) 00:16:30.978 fused_ordering(221) 00:16:30.978 fused_ordering(222) 00:16:30.978 fused_ordering(223) 00:16:30.978 fused_ordering(224) 00:16:30.978 fused_ordering(225) 00:16:30.978 fused_ordering(226) 00:16:30.978 fused_ordering(227) 00:16:30.978 fused_ordering(228) 00:16:30.978 fused_ordering(229) 00:16:30.978 fused_ordering(230) 00:16:30.978 fused_ordering(231) 00:16:30.978 fused_ordering(232) 00:16:30.978 fused_ordering(233) 00:16:30.978 fused_ordering(234) 00:16:30.978 fused_ordering(235) 00:16:30.979 fused_ordering(236) 00:16:30.979 fused_ordering(237) 00:16:30.979 fused_ordering(238) 00:16:30.979 fused_ordering(239) 00:16:30.979 fused_ordering(240) 00:16:30.979 fused_ordering(241) 00:16:30.979 fused_ordering(242) 00:16:30.979 fused_ordering(243) 00:16:30.979 fused_ordering(244) 00:16:30.979 fused_ordering(245) 00:16:30.979 fused_ordering(246) 00:16:30.979 fused_ordering(247) 00:16:30.979 fused_ordering(248) 00:16:30.979 fused_ordering(249) 00:16:30.979 fused_ordering(250) 00:16:30.979 fused_ordering(251) 00:16:30.979 fused_ordering(252) 00:16:30.979 fused_ordering(253) 00:16:30.979 fused_ordering(254) 00:16:30.979 fused_ordering(255) 00:16:30.979 fused_ordering(256) 00:16:30.979 fused_ordering(257) 00:16:30.979 fused_ordering(258) 00:16:30.979 fused_ordering(259) 00:16:30.979 fused_ordering(260) 00:16:30.979 fused_ordering(261) 00:16:30.979 fused_ordering(262) 00:16:30.979 fused_ordering(263) 00:16:30.979 fused_ordering(264) 00:16:30.979 fused_ordering(265) 00:16:30.979 fused_ordering(266) 00:16:30.979 fused_ordering(267) 00:16:30.979 fused_ordering(268) 00:16:30.979 fused_ordering(269) 00:16:30.979 fused_ordering(270) 00:16:30.979 fused_ordering(271) 00:16:30.979 fused_ordering(272) 00:16:30.979 fused_ordering(273) 00:16:30.979 fused_ordering(274) 00:16:30.979 fused_ordering(275) 00:16:30.979 fused_ordering(276) 00:16:30.979 fused_ordering(277) 00:16:30.979 fused_ordering(278) 00:16:30.979 fused_ordering(279) 00:16:30.979 fused_ordering(280) 00:16:30.979 fused_ordering(281) 00:16:30.979 fused_ordering(282) 00:16:30.979 fused_ordering(283) 00:16:30.979 fused_ordering(284) 00:16:30.979 fused_ordering(285) 00:16:30.979 fused_ordering(286) 00:16:30.979 fused_ordering(287) 00:16:30.979 fused_ordering(288) 00:16:30.979 fused_ordering(289) 00:16:30.979 fused_ordering(290) 00:16:30.979 fused_ordering(291) 00:16:30.979 fused_ordering(292) 00:16:30.979 fused_ordering(293) 00:16:30.979 fused_ordering(294) 00:16:30.979 fused_ordering(295) 00:16:30.979 fused_ordering(296) 00:16:30.979 fused_ordering(297) 00:16:30.979 fused_ordering(298) 00:16:30.979 fused_ordering(299) 00:16:30.979 fused_ordering(300) 00:16:30.979 fused_ordering(301) 00:16:30.979 fused_ordering(302) 00:16:30.979 fused_ordering(303) 00:16:30.979 fused_ordering(304) 00:16:30.979 fused_ordering(305) 00:16:30.979 fused_ordering(306) 00:16:30.979 fused_ordering(307) 00:16:30.979 fused_ordering(308) 00:16:30.979 fused_ordering(309) 00:16:30.979 fused_ordering(310) 00:16:30.979 fused_ordering(311) 00:16:30.979 fused_ordering(312) 00:16:30.979 fused_ordering(313) 00:16:30.979 fused_ordering(314) 00:16:30.979 fused_ordering(315) 00:16:30.979 fused_ordering(316) 00:16:30.979 fused_ordering(317) 00:16:30.979 fused_ordering(318) 00:16:30.979 fused_ordering(319) 00:16:30.979 fused_ordering(320) 00:16:30.979 fused_ordering(321) 00:16:30.979 fused_ordering(322) 00:16:30.979 fused_ordering(323) 00:16:30.979 fused_ordering(324) 00:16:30.979 fused_ordering(325) 00:16:30.979 fused_ordering(326) 00:16:30.979 fused_ordering(327) 00:16:30.979 fused_ordering(328) 00:16:30.979 fused_ordering(329) 00:16:30.979 fused_ordering(330) 00:16:30.979 fused_ordering(331) 00:16:30.979 fused_ordering(332) 00:16:30.979 fused_ordering(333) 00:16:30.979 fused_ordering(334) 00:16:30.979 fused_ordering(335) 00:16:30.979 fused_ordering(336) 00:16:30.979 fused_ordering(337) 00:16:30.979 fused_ordering(338) 00:16:30.979 fused_ordering(339) 00:16:30.979 fused_ordering(340) 00:16:30.979 fused_ordering(341) 00:16:30.979 fused_ordering(342) 00:16:30.979 fused_ordering(343) 00:16:30.979 fused_ordering(344) 00:16:30.979 fused_ordering(345) 00:16:30.979 fused_ordering(346) 00:16:30.979 fused_ordering(347) 00:16:30.979 fused_ordering(348) 00:16:30.979 fused_ordering(349) 00:16:30.979 fused_ordering(350) 00:16:30.979 fused_ordering(351) 00:16:30.979 fused_ordering(352) 00:16:30.979 fused_ordering(353) 00:16:30.979 fused_ordering(354) 00:16:30.979 fused_ordering(355) 00:16:30.979 fused_ordering(356) 00:16:30.979 fused_ordering(357) 00:16:30.979 fused_ordering(358) 00:16:30.979 fused_ordering(359) 00:16:30.979 fused_ordering(360) 00:16:30.979 fused_ordering(361) 00:16:30.979 fused_ordering(362) 00:16:30.979 fused_ordering(363) 00:16:30.979 fused_ordering(364) 00:16:30.979 fused_ordering(365) 00:16:30.979 fused_ordering(366) 00:16:30.979 fused_ordering(367) 00:16:30.979 fused_ordering(368) 00:16:30.979 fused_ordering(369) 00:16:30.979 fused_ordering(370) 00:16:30.979 fused_ordering(371) 00:16:30.979 fused_ordering(372) 00:16:30.979 fused_ordering(373) 00:16:30.979 fused_ordering(374) 00:16:30.979 fused_ordering(375) 00:16:30.979 fused_ordering(376) 00:16:30.979 fused_ordering(377) 00:16:30.979 fused_ordering(378) 00:16:30.979 fused_ordering(379) 00:16:30.979 fused_ordering(380) 00:16:30.979 fused_ordering(381) 00:16:30.979 fused_ordering(382) 00:16:30.979 fused_ordering(383) 00:16:30.979 fused_ordering(384) 00:16:30.979 fused_ordering(385) 00:16:30.979 fused_ordering(386) 00:16:30.979 fused_ordering(387) 00:16:30.979 fused_ordering(388) 00:16:30.979 fused_ordering(389) 00:16:30.979 fused_ordering(390) 00:16:30.979 fused_ordering(391) 00:16:30.979 fused_ordering(392) 00:16:30.979 fused_ordering(393) 00:16:30.979 fused_ordering(394) 00:16:30.979 fused_ordering(395) 00:16:30.979 fused_ordering(396) 00:16:30.979 fused_ordering(397) 00:16:30.979 fused_ordering(398) 00:16:30.979 fused_ordering(399) 00:16:30.979 fused_ordering(400) 00:16:30.979 fused_ordering(401) 00:16:30.979 fused_ordering(402) 00:16:30.979 fused_ordering(403) 00:16:30.979 fused_ordering(404) 00:16:30.979 fused_ordering(405) 00:16:30.979 fused_ordering(406) 00:16:30.979 fused_ordering(407) 00:16:30.979 fused_ordering(408) 00:16:30.979 fused_ordering(409) 00:16:30.979 fused_ordering(410) 00:16:30.979 fused_ordering(411) 00:16:30.979 fused_ordering(412) 00:16:30.979 fused_ordering(413) 00:16:30.979 fused_ordering(414) 00:16:30.979 fused_ordering(415) 00:16:30.979 fused_ordering(416) 00:16:30.979 fused_ordering(417) 00:16:30.979 fused_ordering(418) 00:16:30.979 fused_ordering(419) 00:16:30.979 fused_ordering(420) 00:16:30.979 fused_ordering(421) 00:16:30.979 fused_ordering(422) 00:16:30.979 fused_ordering(423) 00:16:30.979 fused_ordering(424) 00:16:30.979 fused_ordering(425) 00:16:30.979 fused_ordering(426) 00:16:30.979 fused_ordering(427) 00:16:30.979 fused_ordering(428) 00:16:30.979 fused_ordering(429) 00:16:30.979 fused_ordering(430) 00:16:30.979 fused_ordering(431) 00:16:30.979 fused_ordering(432) 00:16:30.979 fused_ordering(433) 00:16:30.979 fused_ordering(434) 00:16:30.979 fused_ordering(435) 00:16:30.979 fused_ordering(436) 00:16:30.979 fused_ordering(437) 00:16:30.979 fused_ordering(438) 00:16:30.979 fused_ordering(439) 00:16:30.979 fused_ordering(440) 00:16:30.979 fused_ordering(441) 00:16:30.979 fused_ordering(442) 00:16:30.979 fused_ordering(443) 00:16:30.979 fused_ordering(444) 00:16:30.979 fused_ordering(445) 00:16:30.979 fused_ordering(446) 00:16:30.979 fused_ordering(447) 00:16:30.979 fused_ordering(448) 00:16:30.979 fused_ordering(449) 00:16:30.979 fused_ordering(450) 00:16:30.979 fused_ordering(451) 00:16:30.979 fused_ordering(452) 00:16:30.979 fused_ordering(453) 00:16:30.979 fused_ordering(454) 00:16:30.979 fused_ordering(455) 00:16:30.979 fused_ordering(456) 00:16:30.979 fused_ordering(457) 00:16:30.979 fused_ordering(458) 00:16:30.979 fused_ordering(459) 00:16:30.979 fused_ordering(460) 00:16:30.979 fused_ordering(461) 00:16:30.979 fused_ordering(462) 00:16:30.979 fused_ordering(463) 00:16:30.979 fused_ordering(464) 00:16:30.979 fused_ordering(465) 00:16:30.979 fused_ordering(466) 00:16:30.979 fused_ordering(467) 00:16:30.979 fused_ordering(468) 00:16:30.979 fused_ordering(469) 00:16:30.979 fused_ordering(470) 00:16:30.979 fused_ordering(471) 00:16:30.979 fused_ordering(472) 00:16:30.979 fused_ordering(473) 00:16:30.979 fused_ordering(474) 00:16:30.979 fused_ordering(475) 00:16:30.979 fused_ordering(476) 00:16:30.979 fused_ordering(477) 00:16:30.979 fused_ordering(478) 00:16:30.979 fused_ordering(479) 00:16:30.979 fused_ordering(480) 00:16:30.979 fused_ordering(481) 00:16:30.979 fused_ordering(482) 00:16:30.979 fused_ordering(483) 00:16:30.979 fused_ordering(484) 00:16:30.979 fused_ordering(485) 00:16:30.979 fused_ordering(486) 00:16:30.979 fused_ordering(487) 00:16:30.979 fused_ordering(488) 00:16:30.979 fused_ordering(489) 00:16:30.979 fused_ordering(490) 00:16:30.979 fused_ordering(491) 00:16:30.979 fused_ordering(492) 00:16:30.979 fused_ordering(493) 00:16:30.979 fused_ordering(494) 00:16:30.979 fused_ordering(495) 00:16:30.979 fused_ordering(496) 00:16:30.979 fused_ordering(497) 00:16:30.979 fused_ordering(498) 00:16:30.979 fused_ordering(499) 00:16:30.979 fused_ordering(500) 00:16:30.979 fused_ordering(501) 00:16:30.979 fused_ordering(502) 00:16:30.979 fused_ordering(503) 00:16:30.979 fused_ordering(504) 00:16:30.979 fused_ordering(505) 00:16:30.979 fused_ordering(506) 00:16:30.979 fused_ordering(507) 00:16:30.979 fused_ordering(508) 00:16:30.979 fused_ordering(509) 00:16:30.979 fused_ordering(510) 00:16:30.979 fused_ordering(511) 00:16:30.979 fused_ordering(512) 00:16:30.979 fused_ordering(513) 00:16:30.979 fused_ordering(514) 00:16:30.979 fused_ordering(515) 00:16:30.980 fused_ordering(516) 00:16:30.980 fused_ordering(517) 00:16:30.980 fused_ordering(518) 00:16:30.980 fused_ordering(519) 00:16:30.980 fused_ordering(520) 00:16:30.980 fused_ordering(521) 00:16:30.980 fused_ordering(522) 00:16:30.980 fused_ordering(523) 00:16:30.980 fused_ordering(524) 00:16:30.980 fused_ordering(525) 00:16:30.980 fused_ordering(526) 00:16:30.980 fused_ordering(527) 00:16:30.980 fused_ordering(528) 00:16:30.980 fused_ordering(529) 00:16:30.980 fused_ordering(530) 00:16:30.980 fused_ordering(531) 00:16:30.980 fused_ordering(532) 00:16:30.980 fused_ordering(533) 00:16:30.980 fused_ordering(534) 00:16:30.980 fused_ordering(535) 00:16:30.980 fused_ordering(536) 00:16:30.980 fused_ordering(537) 00:16:30.980 fused_ordering(538) 00:16:30.980 fused_ordering(539) 00:16:30.980 fused_ordering(540) 00:16:30.980 fused_ordering(541) 00:16:30.980 fused_ordering(542) 00:16:30.980 fused_ordering(543) 00:16:30.980 fused_ordering(544) 00:16:30.980 fused_ordering(545) 00:16:30.980 fused_ordering(546) 00:16:30.980 fused_ordering(547) 00:16:30.980 fused_ordering(548) 00:16:30.980 fused_ordering(549) 00:16:30.980 fused_ordering(550) 00:16:30.980 fused_ordering(551) 00:16:30.980 fused_ordering(552) 00:16:30.980 fused_ordering(553) 00:16:30.980 fused_ordering(554) 00:16:30.980 fused_ordering(555) 00:16:30.980 fused_ordering(556) 00:16:30.980 fused_ordering(557) 00:16:30.980 fused_ordering(558) 00:16:30.980 fused_ordering(559) 00:16:30.980 fused_ordering(560) 00:16:30.980 fused_ordering(561) 00:16:30.980 fused_ordering(562) 00:16:30.980 fused_ordering(563) 00:16:30.980 fused_ordering(564) 00:16:30.980 fused_ordering(565) 00:16:30.980 fused_ordering(566) 00:16:30.980 fused_ordering(567) 00:16:30.980 fused_ordering(568) 00:16:30.980 fused_ordering(569) 00:16:30.980 fused_ordering(570) 00:16:30.980 fused_ordering(571) 00:16:30.980 fused_ordering(572) 00:16:30.980 fused_ordering(573) 00:16:30.980 fused_ordering(574) 00:16:30.980 fused_ordering(575) 00:16:30.980 fused_ordering(576) 00:16:30.980 fused_ordering(577) 00:16:30.980 fused_ordering(578) 00:16:30.980 fused_ordering(579) 00:16:30.980 fused_ordering(580) 00:16:30.980 fused_ordering(581) 00:16:30.980 fused_ordering(582) 00:16:30.980 fused_ordering(583) 00:16:30.980 fused_ordering(584) 00:16:30.980 fused_ordering(585) 00:16:30.980 fused_ordering(586) 00:16:30.980 fused_ordering(587) 00:16:30.980 fused_ordering(588) 00:16:30.980 fused_ordering(589) 00:16:30.980 fused_ordering(590) 00:16:30.980 fused_ordering(591) 00:16:30.980 fused_ordering(592) 00:16:30.980 fused_ordering(593) 00:16:30.980 fused_ordering(594) 00:16:30.980 fused_ordering(595) 00:16:30.980 fused_ordering(596) 00:16:30.980 fused_ordering(597) 00:16:30.980 fused_ordering(598) 00:16:30.980 fused_ordering(599) 00:16:30.980 fused_ordering(600) 00:16:30.980 fused_ordering(601) 00:16:30.980 fused_ordering(602) 00:16:30.980 fused_ordering(603) 00:16:30.980 fused_ordering(604) 00:16:30.980 fused_ordering(605) 00:16:30.980 fused_ordering(606) 00:16:30.980 fused_ordering(607) 00:16:30.980 fused_ordering(608) 00:16:30.980 fused_ordering(609) 00:16:30.980 fused_ordering(610) 00:16:30.980 fused_ordering(611) 00:16:30.980 fused_ordering(612) 00:16:30.980 fused_ordering(613) 00:16:30.980 fused_ordering(614) 00:16:30.980 fused_ordering(615) 00:16:30.980 fused_ordering(616) 00:16:30.980 fused_ordering(617) 00:16:30.980 fused_ordering(618) 00:16:30.980 fused_ordering(619) 00:16:30.980 fused_ordering(620) 00:16:30.980 fused_ordering(621) 00:16:30.980 fused_ordering(622) 00:16:30.980 fused_ordering(623) 00:16:30.980 fused_ordering(624) 00:16:30.980 fused_ordering(625) 00:16:30.980 fused_ordering(626) 00:16:30.980 fused_ordering(627) 00:16:30.980 fused_ordering(628) 00:16:30.980 fused_ordering(629) 00:16:30.980 fused_ordering(630) 00:16:30.980 fused_ordering(631) 00:16:30.980 fused_ordering(632) 00:16:30.980 fused_ordering(633) 00:16:30.980 fused_ordering(634) 00:16:30.980 fused_ordering(635) 00:16:30.980 fused_ordering(636) 00:16:30.980 fused_ordering(637) 00:16:30.980 fused_ordering(638) 00:16:30.980 fused_ordering(639) 00:16:30.980 fused_ordering(640) 00:16:30.980 fused_ordering(641) 00:16:30.980 fused_ordering(642) 00:16:30.980 fused_ordering(643) 00:16:30.980 fused_ordering(644) 00:16:30.980 fused_ordering(645) 00:16:30.980 fused_ordering(646) 00:16:30.980 fused_ordering(647) 00:16:30.980 fused_ordering(648) 00:16:30.980 fused_ordering(649) 00:16:30.980 fused_ordering(650) 00:16:30.980 fused_ordering(651) 00:16:30.980 fused_ordering(652) 00:16:30.980 fused_ordering(653) 00:16:30.980 fused_ordering(654) 00:16:30.980 fused_ordering(655) 00:16:30.980 fused_ordering(656) 00:16:30.980 fused_ordering(657) 00:16:30.980 fused_ordering(658) 00:16:30.980 fused_ordering(659) 00:16:30.980 fused_ordering(660) 00:16:30.980 fused_ordering(661) 00:16:30.980 fused_ordering(662) 00:16:30.980 fused_ordering(663) 00:16:30.980 fused_ordering(664) 00:16:30.980 fused_ordering(665) 00:16:30.980 fused_ordering(666) 00:16:30.980 fused_ordering(667) 00:16:30.980 fused_ordering(668) 00:16:30.980 fused_ordering(669) 00:16:30.980 fused_ordering(670) 00:16:30.980 fused_ordering(671) 00:16:30.980 fused_ordering(672) 00:16:30.980 fused_ordering(673) 00:16:30.980 fused_ordering(674) 00:16:30.980 fused_ordering(675) 00:16:30.980 fused_ordering(676) 00:16:30.980 fused_ordering(677) 00:16:30.980 fused_ordering(678) 00:16:30.980 fused_ordering(679) 00:16:30.980 fused_ordering(680) 00:16:30.980 fused_ordering(681) 00:16:30.980 fused_ordering(682) 00:16:30.980 fused_ordering(683) 00:16:30.980 fused_ordering(684) 00:16:30.980 fused_ordering(685) 00:16:30.980 fused_ordering(686) 00:16:30.980 fused_ordering(687) 00:16:30.980 fused_ordering(688) 00:16:30.980 fused_ordering(689) 00:16:30.980 fused_ordering(690) 00:16:30.980 fused_ordering(691) 00:16:30.980 fused_ordering(692) 00:16:30.980 fused_ordering(693) 00:16:30.980 fused_ordering(694) 00:16:30.980 fused_ordering(695) 00:16:30.980 fused_ordering(696) 00:16:30.980 fused_ordering(697) 00:16:30.980 fused_ordering(698) 00:16:30.980 fused_ordering(699) 00:16:30.980 fused_ordering(700) 00:16:30.980 fused_ordering(701) 00:16:30.980 fused_ordering(702) 00:16:30.980 fused_ordering(703) 00:16:30.980 fused_ordering(704) 00:16:30.980 fused_ordering(705) 00:16:30.980 fused_ordering(706) 00:16:30.980 fused_ordering(707) 00:16:30.980 fused_ordering(708) 00:16:30.980 fused_ordering(709) 00:16:30.980 fused_ordering(710) 00:16:30.980 fused_ordering(711) 00:16:30.980 fused_ordering(712) 00:16:30.980 fused_ordering(713) 00:16:30.980 fused_ordering(714) 00:16:30.980 fused_ordering(715) 00:16:30.980 fused_ordering(716) 00:16:30.980 fused_ordering(717) 00:16:30.980 fused_ordering(718) 00:16:30.980 fused_ordering(719) 00:16:30.980 fused_ordering(720) 00:16:30.980 fused_ordering(721) 00:16:30.980 fused_ordering(722) 00:16:30.980 fused_ordering(723) 00:16:30.980 fused_ordering(724) 00:16:30.980 fused_ordering(725) 00:16:30.980 fused_ordering(726) 00:16:30.980 fused_ordering(727) 00:16:30.980 fused_ordering(728) 00:16:30.980 fused_ordering(729) 00:16:30.980 fused_ordering(730) 00:16:30.980 fused_ordering(731) 00:16:30.980 fused_ordering(732) 00:16:30.980 fused_ordering(733) 00:16:30.980 fused_ordering(734) 00:16:30.980 fused_ordering(735) 00:16:30.980 fused_ordering(736) 00:16:30.980 fused_ordering(737) 00:16:30.980 fused_ordering(738) 00:16:30.980 fused_ordering(739) 00:16:30.980 fused_ordering(740) 00:16:30.980 fused_ordering(741) 00:16:30.980 fused_ordering(742) 00:16:30.980 fused_ordering(743) 00:16:30.980 fused_ordering(744) 00:16:30.980 fused_ordering(745) 00:16:30.980 fused_ordering(746) 00:16:30.980 fused_ordering(747) 00:16:30.980 fused_ordering(748) 00:16:30.980 fused_ordering(749) 00:16:30.980 fused_ordering(750) 00:16:30.980 fused_ordering(751) 00:16:30.980 fused_ordering(752) 00:16:30.980 fused_ordering(753) 00:16:30.980 fused_ordering(754) 00:16:30.980 fused_ordering(755) 00:16:30.980 fused_ordering(756) 00:16:30.980 fused_ordering(757) 00:16:30.980 fused_ordering(758) 00:16:30.980 fused_ordering(759) 00:16:30.980 fused_ordering(760) 00:16:30.980 fused_ordering(761) 00:16:30.980 fused_ordering(762) 00:16:30.980 fused_ordering(763) 00:16:30.980 fused_ordering(764) 00:16:30.980 fused_ordering(765) 00:16:30.980 fused_ordering(766) 00:16:30.980 fused_ordering(767) 00:16:30.980 fused_ordering(768) 00:16:30.980 fused_ordering(769) 00:16:30.980 fused_ordering(770) 00:16:30.980 fused_ordering(771) 00:16:30.980 fused_ordering(772) 00:16:30.980 fused_ordering(773) 00:16:30.980 fused_ordering(774) 00:16:30.980 fused_ordering(775) 00:16:30.980 fused_ordering(776) 00:16:30.980 fused_ordering(777) 00:16:30.980 fused_ordering(778) 00:16:30.980 fused_ordering(779) 00:16:30.980 fused_ordering(780) 00:16:30.980 fused_ordering(781) 00:16:30.980 fused_ordering(782) 00:16:30.980 fused_ordering(783) 00:16:30.980 fused_ordering(784) 00:16:30.980 fused_ordering(785) 00:16:30.981 fused_ordering(786) 00:16:30.981 fused_ordering(787) 00:16:30.981 fused_ordering(788) 00:16:30.981 fused_ordering(789) 00:16:30.981 fused_ordering(790) 00:16:30.981 fused_ordering(791) 00:16:30.981 fused_ordering(792) 00:16:30.981 fused_ordering(793) 00:16:30.981 fused_ordering(794) 00:16:30.981 fused_ordering(795) 00:16:30.981 fused_ordering(796) 00:16:30.981 fused_ordering(797) 00:16:30.981 fused_ordering(798) 00:16:30.981 fused_ordering(799) 00:16:30.981 fused_ordering(800) 00:16:30.981 fused_ordering(801) 00:16:30.981 fused_ordering(802) 00:16:30.981 fused_ordering(803) 00:16:30.981 fused_ordering(804) 00:16:30.981 fused_ordering(805) 00:16:30.981 fused_ordering(806) 00:16:30.981 fused_ordering(807) 00:16:30.981 fused_ordering(808) 00:16:30.981 fused_ordering(809) 00:16:30.981 fused_ordering(810) 00:16:30.981 fused_ordering(811) 00:16:30.981 fused_ordering(812) 00:16:30.981 fused_ordering(813) 00:16:30.981 fused_ordering(814) 00:16:30.981 fused_ordering(815) 00:16:30.981 fused_ordering(816) 00:16:30.981 fused_ordering(817) 00:16:30.981 fused_ordering(818) 00:16:30.981 fused_ordering(819) 00:16:30.981 fused_ordering(820) 00:16:31.241 fused_ordering(821) 00:16:31.241 fused_ordering(822) 00:16:31.241 fused_ordering(823) 00:16:31.241 fused_ordering(824) 00:16:31.241 fused_ordering(825) 00:16:31.241 fused_ordering(826) 00:16:31.241 fused_ordering(827) 00:16:31.241 fused_ordering(828) 00:16:31.241 fused_ordering(829) 00:16:31.241 fused_ordering(830) 00:16:31.241 fused_ordering(831) 00:16:31.241 fused_ordering(832) 00:16:31.241 fused_ordering(833) 00:16:31.241 fused_ordering(834) 00:16:31.241 fused_ordering(835) 00:16:31.241 fused_ordering(836) 00:16:31.241 fused_ordering(837) 00:16:31.241 fused_ordering(838) 00:16:31.241 fused_ordering(839) 00:16:31.241 fused_ordering(840) 00:16:31.241 fused_ordering(841) 00:16:31.241 fused_ordering(842) 00:16:31.241 fused_ordering(843) 00:16:31.241 fused_ordering(844) 00:16:31.241 fused_ordering(845) 00:16:31.241 fused_ordering(846) 00:16:31.241 fused_ordering(847) 00:16:31.241 fused_ordering(848) 00:16:31.241 fused_ordering(849) 00:16:31.241 fused_ordering(850) 00:16:31.241 fused_ordering(851) 00:16:31.241 fused_ordering(852) 00:16:31.241 fused_ordering(853) 00:16:31.241 fused_ordering(854) 00:16:31.241 fused_ordering(855) 00:16:31.241 fused_ordering(856) 00:16:31.241 fused_ordering(857) 00:16:31.241 fused_ordering(858) 00:16:31.241 fused_ordering(859) 00:16:31.241 fused_ordering(860) 00:16:31.241 fused_ordering(861) 00:16:31.241 fused_ordering(862) 00:16:31.241 fused_ordering(863) 00:16:31.241 fused_ordering(864) 00:16:31.241 fused_ordering(865) 00:16:31.241 fused_ordering(866) 00:16:31.241 fused_ordering(867) 00:16:31.241 fused_ordering(868) 00:16:31.241 fused_ordering(869) 00:16:31.241 fused_ordering(870) 00:16:31.241 fused_ordering(871) 00:16:31.241 fused_ordering(872) 00:16:31.241 fused_ordering(873) 00:16:31.241 fused_ordering(874) 00:16:31.241 fused_ordering(875) 00:16:31.241 fused_ordering(876) 00:16:31.241 fused_ordering(877) 00:16:31.241 fused_ordering(878) 00:16:31.241 fused_ordering(879) 00:16:31.241 fused_ordering(880) 00:16:31.241 fused_ordering(881) 00:16:31.241 fused_ordering(882) 00:16:31.241 fused_ordering(883) 00:16:31.241 fused_ordering(884) 00:16:31.241 fused_ordering(885) 00:16:31.241 fused_ordering(886) 00:16:31.241 fused_ordering(887) 00:16:31.241 fused_ordering(888) 00:16:31.241 fused_ordering(889) 00:16:31.241 fused_ordering(890) 00:16:31.242 fused_ordering(891) 00:16:31.242 fused_ordering(892) 00:16:31.242 fused_ordering(893) 00:16:31.242 fused_ordering(894) 00:16:31.242 fused_ordering(895) 00:16:31.242 fused_ordering(896) 00:16:31.242 fused_ordering(897) 00:16:31.242 fused_ordering(898) 00:16:31.242 fused_ordering(899) 00:16:31.242 fused_ordering(900) 00:16:31.242 fused_ordering(901) 00:16:31.242 fused_ordering(902) 00:16:31.242 fused_ordering(903) 00:16:31.242 fused_ordering(904) 00:16:31.242 fused_ordering(905) 00:16:31.242 fused_ordering(906) 00:16:31.242 fused_ordering(907) 00:16:31.242 fused_ordering(908) 00:16:31.242 fused_ordering(909) 00:16:31.242 fused_ordering(910) 00:16:31.242 fused_ordering(911) 00:16:31.242 fused_ordering(912) 00:16:31.242 fused_ordering(913) 00:16:31.242 fused_ordering(914) 00:16:31.242 fused_ordering(915) 00:16:31.242 fused_ordering(916) 00:16:31.242 fused_ordering(917) 00:16:31.242 fused_ordering(918) 00:16:31.242 fused_ordering(919) 00:16:31.242 fused_ordering(920) 00:16:31.242 fused_ordering(921) 00:16:31.242 fused_ordering(922) 00:16:31.242 fused_ordering(923) 00:16:31.242 fused_ordering(924) 00:16:31.242 fused_ordering(925) 00:16:31.242 fused_ordering(926) 00:16:31.242 fused_ordering(927) 00:16:31.242 fused_ordering(928) 00:16:31.242 fused_ordering(929) 00:16:31.242 fused_ordering(930) 00:16:31.242 fused_ordering(931) 00:16:31.242 fused_ordering(932) 00:16:31.242 fused_ordering(933) 00:16:31.242 fused_ordering(934) 00:16:31.242 fused_ordering(935) 00:16:31.242 fused_ordering(936) 00:16:31.242 fused_ordering(937) 00:16:31.242 fused_ordering(938) 00:16:31.242 fused_ordering(939) 00:16:31.242 fused_ordering(940) 00:16:31.242 fused_ordering(941) 00:16:31.242 fused_ordering(942) 00:16:31.242 fused_ordering(943) 00:16:31.242 fused_ordering(944) 00:16:31.242 fused_ordering(945) 00:16:31.242 fused_ordering(946) 00:16:31.242 fused_ordering(947) 00:16:31.242 fused_ordering(948) 00:16:31.242 fused_ordering(949) 00:16:31.242 fused_ordering(950) 00:16:31.242 fused_ordering(951) 00:16:31.242 fused_ordering(952) 00:16:31.242 fused_ordering(953) 00:16:31.242 fused_ordering(954) 00:16:31.242 fused_ordering(955) 00:16:31.242 fused_ordering(956) 00:16:31.242 fused_ordering(957) 00:16:31.242 fused_ordering(958) 00:16:31.242 fused_ordering(959) 00:16:31.242 fused_ordering(960) 00:16:31.242 fused_ordering(961) 00:16:31.242 fused_ordering(962) 00:16:31.242 fused_ordering(963) 00:16:31.242 fused_ordering(964) 00:16:31.242 fused_ordering(965) 00:16:31.242 fused_ordering(966) 00:16:31.242 fused_ordering(967) 00:16:31.242 fused_ordering(968) 00:16:31.242 fused_ordering(969) 00:16:31.242 fused_ordering(970) 00:16:31.242 fused_ordering(971) 00:16:31.242 fused_ordering(972) 00:16:31.242 fused_ordering(973) 00:16:31.242 fused_ordering(974) 00:16:31.242 fused_ordering(975) 00:16:31.242 fused_ordering(976) 00:16:31.242 fused_ordering(977) 00:16:31.242 fused_ordering(978) 00:16:31.242 fused_ordering(979) 00:16:31.242 fused_ordering(980) 00:16:31.242 fused_ordering(981) 00:16:31.242 fused_ordering(982) 00:16:31.242 fused_ordering(983) 00:16:31.242 fused_ordering(984) 00:16:31.242 fused_ordering(985) 00:16:31.242 fused_ordering(986) 00:16:31.242 fused_ordering(987) 00:16:31.242 fused_ordering(988) 00:16:31.242 fused_ordering(989) 00:16:31.242 fused_ordering(990) 00:16:31.242 fused_ordering(991) 00:16:31.242 fused_ordering(992) 00:16:31.242 fused_ordering(993) 00:16:31.242 fused_ordering(994) 00:16:31.242 fused_ordering(995) 00:16:31.242 fused_ordering(996) 00:16:31.242 fused_ordering(997) 00:16:31.242 fused_ordering(998) 00:16:31.242 fused_ordering(999) 00:16:31.242 fused_ordering(1000) 00:16:31.242 fused_ordering(1001) 00:16:31.242 fused_ordering(1002) 00:16:31.242 fused_ordering(1003) 00:16:31.242 fused_ordering(1004) 00:16:31.242 fused_ordering(1005) 00:16:31.242 fused_ordering(1006) 00:16:31.242 fused_ordering(1007) 00:16:31.242 fused_ordering(1008) 00:16:31.242 fused_ordering(1009) 00:16:31.242 fused_ordering(1010) 00:16:31.242 fused_ordering(1011) 00:16:31.242 fused_ordering(1012) 00:16:31.242 fused_ordering(1013) 00:16:31.242 fused_ordering(1014) 00:16:31.242 fused_ordering(1015) 00:16:31.242 fused_ordering(1016) 00:16:31.242 fused_ordering(1017) 00:16:31.242 fused_ordering(1018) 00:16:31.242 fused_ordering(1019) 00:16:31.242 fused_ordering(1020) 00:16:31.242 fused_ordering(1021) 00:16:31.242 fused_ordering(1022) 00:16:31.242 fused_ordering(1023) 00:16:31.242 00:50:38 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:16:31.242 00:50:38 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:16:31.242 00:50:38 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:31.242 00:50:38 -- nvmf/common.sh@117 -- # sync 00:16:31.242 00:50:38 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:31.242 00:50:38 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:31.242 00:50:38 -- nvmf/common.sh@120 -- # set +e 00:16:31.242 00:50:38 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:31.242 00:50:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:31.242 rmmod nvme_rdma 00:16:31.242 rmmod nvme_fabrics 00:16:31.242 00:50:38 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:31.242 00:50:38 -- nvmf/common.sh@124 -- # set -e 00:16:31.242 00:50:38 -- nvmf/common.sh@125 -- # return 0 00:16:31.242 00:50:38 -- nvmf/common.sh@478 -- # '[' -n 278792 ']' 00:16:31.242 00:50:38 -- nvmf/common.sh@479 -- # killprocess 278792 00:16:31.242 00:50:38 -- common/autotest_common.sh@936 -- # '[' -z 278792 ']' 00:16:31.242 00:50:38 -- common/autotest_common.sh@940 -- # kill -0 278792 00:16:31.242 00:50:38 -- common/autotest_common.sh@941 -- # uname 00:16:31.242 00:50:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:31.242 00:50:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 278792 00:16:31.502 00:50:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:31.502 00:50:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:31.502 00:50:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 278792' 00:16:31.502 killing process with pid 278792 00:16:31.502 00:50:38 -- common/autotest_common.sh@955 -- # kill 278792 00:16:31.502 00:50:38 -- common/autotest_common.sh@960 -- # wait 278792 00:16:31.502 [2024-04-26 00:50:38.475285] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:31.502 00:50:38 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:31.502 00:50:38 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:31.502 00:16:31.502 real 0m7.378s 00:16:31.502 user 0m4.104s 00:16:31.502 sys 0m4.397s 00:16:31.502 00:50:38 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:31.502 00:50:38 -- common/autotest_common.sh@10 -- # set +x 00:16:31.502 ************************************ 00:16:31.502 END TEST nvmf_fused_ordering 00:16:31.502 ************************************ 00:16:31.763 00:50:38 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:16:31.763 00:50:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:31.763 00:50:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:31.763 00:50:38 -- common/autotest_common.sh@10 -- # set +x 00:16:31.763 ************************************ 00:16:31.763 START TEST nvmf_delete_subsystem 00:16:31.763 ************************************ 00:16:31.763 00:50:38 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:16:31.763 * Looking for test storage... 00:16:31.763 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:31.763 00:50:38 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:31.763 00:50:38 -- nvmf/common.sh@7 -- # uname -s 00:16:31.763 00:50:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:31.763 00:50:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:31.763 00:50:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:31.763 00:50:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:31.763 00:50:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:31.763 00:50:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:31.763 00:50:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:31.763 00:50:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:31.763 00:50:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:31.763 00:50:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:31.763 00:50:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:31.763 00:50:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:31.763 00:50:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:31.763 00:50:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:31.763 00:50:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:31.763 00:50:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:31.763 00:50:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:31.763 00:50:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:31.763 00:50:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:31.763 00:50:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:31.763 00:50:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:31.763 00:50:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:31.763 00:50:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:31.763 00:50:38 -- paths/export.sh@5 -- # export PATH 00:16:31.763 00:50:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:31.763 00:50:38 -- nvmf/common.sh@47 -- # : 0 00:16:31.763 00:50:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:31.763 00:50:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:31.763 00:50:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:31.763 00:50:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:31.763 00:50:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:31.763 00:50:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:31.763 00:50:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:31.763 00:50:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:31.763 00:50:38 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:16:31.763 00:50:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:31.763 00:50:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:31.763 00:50:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:31.763 00:50:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:31.763 00:50:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:31.763 00:50:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:31.763 00:50:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:31.763 00:50:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:31.763 00:50:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:31.763 00:50:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:31.763 00:50:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:31.763 00:50:38 -- common/autotest_common.sh@10 -- # set +x 00:16:37.044 00:50:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:37.044 00:50:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:37.044 00:50:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:37.044 00:50:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:37.044 00:50:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:37.044 00:50:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:37.044 00:50:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:37.044 00:50:44 -- nvmf/common.sh@295 -- # net_devs=() 00:16:37.044 00:50:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:37.044 00:50:44 -- nvmf/common.sh@296 -- # e810=() 00:16:37.044 00:50:44 -- nvmf/common.sh@296 -- # local -ga e810 00:16:37.044 00:50:44 -- nvmf/common.sh@297 -- # x722=() 00:16:37.044 00:50:44 -- nvmf/common.sh@297 -- # local -ga x722 00:16:37.044 00:50:44 -- nvmf/common.sh@298 -- # mlx=() 00:16:37.044 00:50:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:37.044 00:50:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:37.044 00:50:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:37.044 00:50:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:37.044 00:50:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:37.044 00:50:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:37.044 00:50:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:37.045 00:50:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:37.045 00:50:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:37.045 00:50:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:37.045 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:37.045 00:50:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:37.045 00:50:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:37.045 00:50:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:37.045 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:37.045 00:50:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:37.045 00:50:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:37.045 00:50:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:37.045 00:50:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.045 00:50:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:37.045 00:50:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.045 00:50:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:37.045 Found net devices under 0000:18:00.0: mlx_0_0 00:16:37.045 00:50:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.045 00:50:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:37.045 00:50:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:37.045 00:50:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:37.045 00:50:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:37.045 00:50:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:37.045 Found net devices under 0000:18:00.1: mlx_0_1 00:16:37.045 00:50:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:37.045 00:50:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:37.045 00:50:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:37.045 00:50:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:37.045 00:50:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:37.045 00:50:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:37.045 00:50:44 -- nvmf/common.sh@58 -- # uname 00:16:37.045 00:50:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:37.045 00:50:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:37.307 00:50:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:37.307 00:50:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:37.307 00:50:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:37.307 00:50:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:37.307 00:50:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:37.307 00:50:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:37.307 00:50:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:37.307 00:50:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:37.307 00:50:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:37.307 00:50:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:37.307 00:50:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:37.307 00:50:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:37.307 00:50:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:37.307 00:50:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:37.307 00:50:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:37.307 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.307 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:37.307 00:50:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:37.307 00:50:44 -- nvmf/common.sh@105 -- # continue 2 00:16:37.307 00:50:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:37.307 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.307 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:37.307 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.307 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:37.307 00:50:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:37.307 00:50:44 -- nvmf/common.sh@105 -- # continue 2 00:16:37.307 00:50:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:37.307 00:50:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:37.307 00:50:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:37.307 00:50:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:37.307 00:50:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:37.307 00:50:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:37.307 00:50:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:37.307 00:50:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:37.307 00:50:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:37.307 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:37.307 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:37.307 altname enp24s0f0np0 00:16:37.308 altname ens785f0np0 00:16:37.308 inet 192.168.100.8/24 scope global mlx_0_0 00:16:37.308 valid_lft forever preferred_lft forever 00:16:37.308 00:50:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:37.308 00:50:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:37.308 00:50:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:37.308 00:50:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:37.308 00:50:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:37.308 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:37.308 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:37.308 altname enp24s0f1np1 00:16:37.308 altname ens785f1np1 00:16:37.308 inet 192.168.100.9/24 scope global mlx_0_1 00:16:37.308 valid_lft forever preferred_lft forever 00:16:37.308 00:50:44 -- nvmf/common.sh@411 -- # return 0 00:16:37.308 00:50:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:37.308 00:50:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:37.308 00:50:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:37.308 00:50:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:37.308 00:50:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:37.308 00:50:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:37.308 00:50:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:37.308 00:50:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:37.308 00:50:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:37.308 00:50:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:37.308 00:50:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:37.308 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.308 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:37.308 00:50:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:37.308 00:50:44 -- nvmf/common.sh@105 -- # continue 2 00:16:37.308 00:50:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:37.308 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.308 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:37.308 00:50:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:37.308 00:50:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:37.308 00:50:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@105 -- # continue 2 00:16:37.308 00:50:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:37.308 00:50:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:37.308 00:50:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:37.308 00:50:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:37.308 00:50:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:37.308 00:50:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:37.308 00:50:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:37.308 192.168.100.9' 00:16:37.308 00:50:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:37.308 192.168.100.9' 00:16:37.308 00:50:44 -- nvmf/common.sh@446 -- # head -n 1 00:16:37.308 00:50:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:37.308 00:50:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:37.308 192.168.100.9' 00:16:37.308 00:50:44 -- nvmf/common.sh@447 -- # tail -n +2 00:16:37.308 00:50:44 -- nvmf/common.sh@447 -- # head -n 1 00:16:37.308 00:50:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:37.308 00:50:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:37.308 00:50:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:37.308 00:50:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:37.308 00:50:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:37.308 00:50:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:37.308 00:50:44 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:16:37.308 00:50:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:37.308 00:50:44 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:37.308 00:50:44 -- common/autotest_common.sh@10 -- # set +x 00:16:37.308 00:50:44 -- nvmf/common.sh@470 -- # nvmfpid=282506 00:16:37.308 00:50:44 -- nvmf/common.sh@471 -- # waitforlisten 282506 00:16:37.308 00:50:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:37.308 00:50:44 -- common/autotest_common.sh@817 -- # '[' -z 282506 ']' 00:16:37.308 00:50:44 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:37.308 00:50:44 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:37.308 00:50:44 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:37.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:37.308 00:50:44 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:37.308 00:50:44 -- common/autotest_common.sh@10 -- # set +x 00:16:37.308 [2024-04-26 00:50:44.465349] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:16:37.308 [2024-04-26 00:50:44.465389] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:37.308 EAL: No free 2048 kB hugepages reported on node 1 00:16:37.567 [2024-04-26 00:50:44.516011] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:37.567 [2024-04-26 00:50:44.585937] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.567 [2024-04-26 00:50:44.585974] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.567 [2024-04-26 00:50:44.585980] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:37.567 [2024-04-26 00:50:44.585986] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:37.567 [2024-04-26 00:50:44.585990] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.567 [2024-04-26 00:50:44.586027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.567 [2024-04-26 00:50:44.586030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:38.136 00:50:45 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:38.136 00:50:45 -- common/autotest_common.sh@850 -- # return 0 00:16:38.136 00:50:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:38.136 00:50:45 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:38.136 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.136 00:50:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:38.136 00:50:45 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:38.136 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.136 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.136 [2024-04-26 00:50:45.291027] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb012b0/0xb057a0) succeed. 00:16:38.136 [2024-04-26 00:50:45.298960] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb027b0/0xb46e30) succeed. 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:38.396 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.396 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:38.396 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.396 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.396 [2024-04-26 00:50:45.385752] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:16:38.396 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.396 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.396 NULL1 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:38.396 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.396 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.396 Delay0 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:38.396 00:50:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:38.396 00:50:45 -- common/autotest_common.sh@10 -- # set +x 00:16:38.396 00:50:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@28 -- # perf_pid=282599 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@30 -- # sleep 2 00:16:38.396 00:50:45 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:38.396 EAL: No free 2048 kB hugepages reported on node 1 00:16:38.396 [2024-04-26 00:50:45.477931] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:40.307 00:50:47 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:40.307 00:50:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:40.307 00:50:47 -- common/autotest_common.sh@10 -- # set +x 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 NVMe io qpair process completion error 00:16:41.691 00:50:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:41.691 00:50:48 -- target/delete_subsystem.sh@34 -- # delay=0 00:16:41.691 00:50:48 -- target/delete_subsystem.sh@35 -- # kill -0 282599 00:16:41.691 00:50:48 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:41.952 00:50:49 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:41.952 00:50:49 -- target/delete_subsystem.sh@35 -- # kill -0 282599 00:16:41.952 00:50:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 starting I/O failed: -6 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 Write completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.524 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 starting I/O failed: -6 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Write completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.525 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Read completed with error (sct=0, sc=8) 00:16:42.526 Write completed with error (sct=0, sc=8) 00:16:42.526 00:50:49 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:42.526 00:50:49 -- target/delete_subsystem.sh@35 -- # kill -0 282599 00:16:42.526 00:50:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:16:42.526 [2024-04-26 00:50:49.565101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:42.526 [2024-04-26 00:50:49.565136] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:42.526 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:16:42.526 Initializing NVMe Controllers 00:16:42.526 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:42.526 Controller IO queue size 128, less than required. 00:16:42.526 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:42.526 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:42.526 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:42.526 Initialization complete. Launching workers. 00:16:42.526 ======================================================== 00:16:42.526 Latency(us) 00:16:42.526 Device Information : IOPS MiB/s Average min max 00:16:42.526 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.34 0.04 1596081.62 1000303.43 2983420.56 00:16:42.526 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.34 0.04 1597440.94 1001476.85 2983587.21 00:16:42.526 ======================================================== 00:16:42.526 Total : 160.67 0.08 1596761.28 1000303.43 2983587.21 00:16:42.526 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@35 -- # kill -0 282599 00:16:43.098 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (282599) - No such process 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@45 -- # NOT wait 282599 00:16:43.098 00:50:50 -- common/autotest_common.sh@638 -- # local es=0 00:16:43.098 00:50:50 -- common/autotest_common.sh@640 -- # valid_exec_arg wait 282599 00:16:43.098 00:50:50 -- common/autotest_common.sh@626 -- # local arg=wait 00:16:43.098 00:50:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:43.098 00:50:50 -- common/autotest_common.sh@630 -- # type -t wait 00:16:43.098 00:50:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:16:43.098 00:50:50 -- common/autotest_common.sh@641 -- # wait 282599 00:16:43.098 00:50:50 -- common/autotest_common.sh@641 -- # es=1 00:16:43.098 00:50:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:16:43.098 00:50:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:16:43.098 00:50:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:43.098 00:50:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.098 00:50:50 -- common/autotest_common.sh@10 -- # set +x 00:16:43.098 00:50:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:43.098 00:50:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.098 00:50:50 -- common/autotest_common.sh@10 -- # set +x 00:16:43.098 [2024-04-26 00:50:50.079658] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:43.098 00:50:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:16:43.098 00:50:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:16:43.098 00:50:50 -- common/autotest_common.sh@10 -- # set +x 00:16:43.098 00:50:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@54 -- # perf_pid=283482 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@56 -- # delay=0 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:43.098 00:50:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:43.098 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.098 [2024-04-26 00:50:50.160760] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:16:43.669 00:50:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:43.669 00:50:50 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:43.669 00:50:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:43.929 00:50:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:43.929 00:50:51 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:43.929 00:50:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:44.500 00:50:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:44.500 00:50:51 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:44.500 00:50:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:45.069 00:50:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:45.069 00:50:52 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:45.069 00:50:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:45.639 00:50:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:45.639 00:50:52 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:45.639 00:50:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:46.207 00:50:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:46.207 00:50:53 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:46.207 00:50:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:46.466 00:50:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:46.466 00:50:53 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:46.466 00:50:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:47.034 00:50:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:47.034 00:50:54 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:47.034 00:50:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:47.604 00:50:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:47.604 00:50:54 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:47.604 00:50:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:48.174 00:50:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:48.174 00:50:55 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:48.174 00:50:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:48.743 00:50:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:48.743 00:50:55 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:48.743 00:50:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:49.003 00:50:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:49.003 00:50:56 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:49.003 00:50:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:49.572 00:50:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:49.572 00:50:56 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:49.572 00:50:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:50.142 00:50:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:50.142 00:50:57 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:50.142 00:50:57 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:16:50.142 Initializing NVMe Controllers 00:16:50.142 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:16:50.142 Controller IO queue size 128, less than required. 00:16:50.142 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:16:50.142 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:16:50.142 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:16:50.142 Initialization complete. Launching workers. 00:16:50.142 ======================================================== 00:16:50.142 Latency(us) 00:16:50.142 Device Information : IOPS MiB/s Average min max 00:16:50.142 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001557.86 1000062.82 1003895.95 00:16:50.142 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002733.77 1000382.09 1006347.33 00:16:50.142 ======================================================== 00:16:50.142 Total : 256.00 0.12 1002145.82 1000062.82 1006347.33 00:16:50.142 00:16:50.713 00:50:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:16:50.713 00:50:57 -- target/delete_subsystem.sh@57 -- # kill -0 283482 00:16:50.713 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (283482) - No such process 00:16:50.713 00:50:57 -- target/delete_subsystem.sh@67 -- # wait 283482 00:16:50.713 00:50:57 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:16:50.713 00:50:57 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:16:50.713 00:50:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:16:50.713 00:50:57 -- nvmf/common.sh@117 -- # sync 00:16:50.713 00:50:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:16:50.713 00:50:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:16:50.713 00:50:57 -- nvmf/common.sh@120 -- # set +e 00:16:50.713 00:50:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:16:50.713 00:50:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:16:50.713 rmmod nvme_rdma 00:16:50.713 rmmod nvme_fabrics 00:16:50.713 00:50:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:16:50.713 00:50:57 -- nvmf/common.sh@124 -- # set -e 00:16:50.713 00:50:57 -- nvmf/common.sh@125 -- # return 0 00:16:50.713 00:50:57 -- nvmf/common.sh@478 -- # '[' -n 282506 ']' 00:16:50.713 00:50:57 -- nvmf/common.sh@479 -- # killprocess 282506 00:16:50.713 00:50:57 -- common/autotest_common.sh@936 -- # '[' -z 282506 ']' 00:16:50.713 00:50:57 -- common/autotest_common.sh@940 -- # kill -0 282506 00:16:50.713 00:50:57 -- common/autotest_common.sh@941 -- # uname 00:16:50.713 00:50:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:50.713 00:50:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 282506 00:16:50.713 00:50:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:50.713 00:50:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:50.713 00:50:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 282506' 00:16:50.713 killing process with pid 282506 00:16:50.713 00:50:57 -- common/autotest_common.sh@955 -- # kill 282506 00:16:50.713 00:50:57 -- common/autotest_common.sh@960 -- # wait 282506 00:16:50.713 [2024-04-26 00:50:57.791878] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:50.973 00:50:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:16:50.973 00:50:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:16:50.973 00:16:50.973 real 0m19.190s 00:16:50.973 user 0m49.632s 00:16:50.973 sys 0m5.248s 00:16:50.973 00:50:57 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:16:50.973 00:50:57 -- common/autotest_common.sh@10 -- # set +x 00:16:50.973 ************************************ 00:16:50.973 END TEST nvmf_delete_subsystem 00:16:50.973 ************************************ 00:16:50.973 00:50:58 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:16:50.973 00:50:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:50.973 00:50:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:50.973 00:50:58 -- common/autotest_common.sh@10 -- # set +x 00:16:50.973 ************************************ 00:16:50.973 START TEST nvmf_ns_masking 00:16:50.973 ************************************ 00:16:51.234 00:50:58 -- common/autotest_common.sh@1111 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:16:51.234 * Looking for test storage... 00:16:51.234 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:51.234 00:50:58 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:16:51.234 00:50:58 -- nvmf/common.sh@7 -- # uname -s 00:16:51.234 00:50:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:51.234 00:50:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:51.234 00:50:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:51.234 00:50:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:51.234 00:50:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:51.234 00:50:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:51.234 00:50:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:51.234 00:50:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:51.234 00:50:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:51.234 00:50:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:51.234 00:50:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:16:51.234 00:50:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:16:51.234 00:50:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:51.234 00:50:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:51.234 00:50:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:51.234 00:50:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:16:51.234 00:50:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:16:51.234 00:50:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:51.234 00:50:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:51.234 00:50:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:51.234 00:50:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.234 00:50:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.234 00:50:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.234 00:50:58 -- paths/export.sh@5 -- # export PATH 00:16:51.234 00:50:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:51.234 00:50:58 -- nvmf/common.sh@47 -- # : 0 00:16:51.234 00:50:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:16:51.234 00:50:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:16:51.234 00:50:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:16:51.234 00:50:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:51.234 00:50:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:51.234 00:50:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:16:51.234 00:50:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:16:51.234 00:50:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:16:51.234 00:50:58 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:16:51.234 00:50:58 -- target/ns_masking.sh@11 -- # loops=5 00:16:51.234 00:50:58 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:16:51.234 00:50:58 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:16:51.235 00:50:58 -- target/ns_masking.sh@15 -- # uuidgen 00:16:51.235 00:50:58 -- target/ns_masking.sh@15 -- # HOSTID=12740632-afcc-42c0-9c90-d1da358de2d5 00:16:51.235 00:50:58 -- target/ns_masking.sh@44 -- # nvmftestinit 00:16:51.235 00:50:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:16:51.235 00:50:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:51.235 00:50:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:16:51.235 00:50:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:16:51.235 00:50:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:16:51.235 00:50:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:51.235 00:50:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:51.235 00:50:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:51.235 00:50:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:16:51.235 00:50:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:16:51.235 00:50:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:16:51.235 00:50:58 -- common/autotest_common.sh@10 -- # set +x 00:16:56.517 00:51:02 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:56.517 00:51:02 -- nvmf/common.sh@291 -- # pci_devs=() 00:16:56.517 00:51:02 -- nvmf/common.sh@291 -- # local -a pci_devs 00:16:56.517 00:51:02 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:16:56.517 00:51:02 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:16:56.517 00:51:02 -- nvmf/common.sh@293 -- # pci_drivers=() 00:16:56.517 00:51:02 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:16:56.517 00:51:02 -- nvmf/common.sh@295 -- # net_devs=() 00:16:56.517 00:51:02 -- nvmf/common.sh@295 -- # local -ga net_devs 00:16:56.517 00:51:02 -- nvmf/common.sh@296 -- # e810=() 00:16:56.517 00:51:02 -- nvmf/common.sh@296 -- # local -ga e810 00:16:56.517 00:51:02 -- nvmf/common.sh@297 -- # x722=() 00:16:56.517 00:51:02 -- nvmf/common.sh@297 -- # local -ga x722 00:16:56.517 00:51:02 -- nvmf/common.sh@298 -- # mlx=() 00:16:56.517 00:51:02 -- nvmf/common.sh@298 -- # local -ga mlx 00:16:56.517 00:51:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:56.517 00:51:02 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:56.517 00:51:02 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:56.517 00:51:02 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:56.518 00:51:02 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:16:56.518 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:16:56.518 00:51:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.518 00:51:02 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:16:56.518 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:16:56.518 00:51:02 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:16:56.518 00:51:02 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.518 00:51:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.518 00:51:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:16:56.518 Found net devices under 0000:18:00.0: mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:56.518 00:51:02 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:56.518 00:51:02 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:16:56.518 Found net devices under 0000:18:00.1: mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:16:56.518 00:51:02 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@403 -- # is_hw=yes 00:16:56.518 00:51:02 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@409 -- # rdma_device_init 00:16:56.518 00:51:02 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:16:56.518 00:51:02 -- nvmf/common.sh@58 -- # uname 00:16:56.518 00:51:02 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:16:56.518 00:51:02 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:16:56.518 00:51:02 -- nvmf/common.sh@63 -- # modprobe ib_core 00:16:56.518 00:51:02 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:16:56.518 00:51:02 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:16:56.518 00:51:02 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:16:56.518 00:51:02 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:16:56.518 00:51:02 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:16:56.518 00:51:02 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:16:56.518 00:51:02 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:16:56.518 00:51:02 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:16:56.518 00:51:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.518 00:51:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.518 00:51:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.518 00:51:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.518 00:51:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@105 -- # continue 2 00:16:56.518 00:51:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@105 -- # continue 2 00:16:56.518 00:51:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.518 00:51:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.518 00:51:02 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:16:56.518 00:51:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:16:56.518 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:56.518 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:16:56.518 altname enp24s0f0np0 00:16:56.518 altname ens785f0np0 00:16:56.518 inet 192.168.100.8/24 scope global mlx_0_0 00:16:56.518 valid_lft forever preferred_lft forever 00:16:56.518 00:51:02 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:16:56.518 00:51:02 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.518 00:51:02 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:16:56.518 00:51:02 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:16:56.518 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:16:56.518 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:16:56.518 altname enp24s0f1np1 00:16:56.518 altname ens785f1np1 00:16:56.518 inet 192.168.100.9/24 scope global mlx_0_1 00:16:56.518 valid_lft forever preferred_lft forever 00:16:56.518 00:51:02 -- nvmf/common.sh@411 -- # return 0 00:16:56.518 00:51:02 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:16:56.518 00:51:02 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:16:56.518 00:51:02 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:16:56.518 00:51:02 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:16:56.518 00:51:02 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:56.518 00:51:02 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:56.518 00:51:02 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:56.518 00:51:02 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:56.518 00:51:02 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:56.518 00:51:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@105 -- # continue 2 00:16:56.518 00:51:02 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:56.518 00:51:02 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:56.518 00:51:02 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@105 -- # continue 2 00:16:56.518 00:51:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.518 00:51:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.518 00:51:02 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:16:56.518 00:51:02 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:56.518 00:51:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:56.518 00:51:02 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:16:56.518 192.168.100.9' 00:16:56.518 00:51:02 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:16:56.518 192.168.100.9' 00:16:56.518 00:51:02 -- nvmf/common.sh@446 -- # head -n 1 00:16:56.518 00:51:02 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:16:56.518 00:51:02 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:16:56.518 192.168.100.9' 00:16:56.518 00:51:02 -- nvmf/common.sh@447 -- # tail -n +2 00:16:56.518 00:51:02 -- nvmf/common.sh@447 -- # head -n 1 00:16:56.518 00:51:02 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:16:56.519 00:51:02 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:16:56.519 00:51:02 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:16:56.519 00:51:02 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:16:56.519 00:51:02 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:16:56.519 00:51:02 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:16:56.519 00:51:02 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:16:56.519 00:51:02 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:56.519 00:51:02 -- common/autotest_common.sh@710 -- # xtrace_disable 00:16:56.519 00:51:02 -- common/autotest_common.sh@10 -- # set +x 00:16:56.519 00:51:02 -- nvmf/common.sh@470 -- # nvmfpid=288097 00:16:56.519 00:51:02 -- nvmf/common.sh@471 -- # waitforlisten 288097 00:16:56.519 00:51:02 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:56.519 00:51:02 -- common/autotest_common.sh@817 -- # '[' -z 288097 ']' 00:16:56.519 00:51:02 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:56.519 00:51:02 -- common/autotest_common.sh@822 -- # local max_retries=100 00:16:56.519 00:51:02 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:56.519 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:56.519 00:51:02 -- common/autotest_common.sh@826 -- # xtrace_disable 00:16:56.519 00:51:02 -- common/autotest_common.sh@10 -- # set +x 00:16:56.519 [2024-04-26 00:51:03.039462] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:16:56.519 [2024-04-26 00:51:03.039518] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:56.519 EAL: No free 2048 kB hugepages reported on node 1 00:16:56.519 [2024-04-26 00:51:03.094769] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:56.519 [2024-04-26 00:51:03.166299] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:56.519 [2024-04-26 00:51:03.166339] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:56.519 [2024-04-26 00:51:03.166347] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:56.519 [2024-04-26 00:51:03.166352] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:56.519 [2024-04-26 00:51:03.166356] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:56.519 [2024-04-26 00:51:03.166413] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:56.519 [2024-04-26 00:51:03.166505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:56.519 [2024-04-26 00:51:03.166591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:56.519 [2024-04-26 00:51:03.166593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:56.779 00:51:03 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:16:56.779 00:51:03 -- common/autotest_common.sh@850 -- # return 0 00:16:56.779 00:51:03 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:56.779 00:51:03 -- common/autotest_common.sh@716 -- # xtrace_disable 00:16:56.779 00:51:03 -- common/autotest_common.sh@10 -- # set +x 00:16:56.779 00:51:03 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:56.779 00:51:03 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:57.039 [2024-04-26 00:51:04.022891] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1f3b880/0x1f3fd70) succeed. 00:16:57.039 [2024-04-26 00:51:04.032066] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1f3cec0/0x1f81400) succeed. 00:16:57.039 00:51:04 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:16:57.039 00:51:04 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:16:57.039 00:51:04 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:57.299 Malloc1 00:16:57.299 00:51:04 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:57.558 Malloc2 00:16:57.558 00:51:04 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:57.558 00:51:04 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:16:57.818 00:51:04 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:16:58.078 [2024-04-26 00:51:05.027894] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:58.078 00:51:05 -- target/ns_masking.sh@61 -- # connect 00:16:58.078 00:51:05 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 12740632-afcc-42c0-9c90-d1da358de2d5 -a 192.168.100.8 -s 4420 -i 4 00:16:58.338 00:51:05 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:16:58.338 00:51:05 -- common/autotest_common.sh@1184 -- # local i=0 00:16:58.338 00:51:05 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:16:58.338 00:51:05 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:16:58.338 00:51:05 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:00.250 00:51:07 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:00.250 00:51:07 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:00.250 00:51:07 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:00.250 00:51:07 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:17:00.250 00:51:07 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:00.250 00:51:07 -- common/autotest_common.sh@1194 -- # return 0 00:17:00.250 00:51:07 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:17:00.250 00:51:07 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:17:00.250 00:51:07 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:17:00.250 00:51:07 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:17:00.250 00:51:07 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:17:00.250 00:51:07 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:00.250 00:51:07 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:00.250 [ 0]:0x1 00:17:00.250 00:51:07 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:00.250 00:51:07 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # nguid=2c5b9f23911542b4ae8ca9225583a96f 00:17:00.511 00:51:07 -- target/ns_masking.sh@41 -- # [[ 2c5b9f23911542b4ae8ca9225583a96f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:00.511 00:51:07 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:17:00.511 00:51:07 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:17:00.511 00:51:07 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:00.511 00:51:07 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:00.511 [ 0]:0x1 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # nguid=2c5b9f23911542b4ae8ca9225583a96f 00:17:00.511 00:51:07 -- target/ns_masking.sh@41 -- # [[ 2c5b9f23911542b4ae8ca9225583a96f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:00.511 00:51:07 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:17:00.511 00:51:07 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:00.511 00:51:07 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:00.511 [ 1]:0x2 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:00.511 00:51:07 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:00.771 00:51:07 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:00.771 00:51:07 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:00.771 00:51:07 -- target/ns_masking.sh@69 -- # disconnect 00:17:00.771 00:51:07 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:01.033 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:01.033 00:51:08 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:17:01.293 00:51:08 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:17:01.293 00:51:08 -- target/ns_masking.sh@77 -- # connect 1 00:17:01.293 00:51:08 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 12740632-afcc-42c0-9c90-d1da358de2d5 -a 192.168.100.8 -s 4420 -i 4 00:17:01.553 00:51:08 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:17:01.553 00:51:08 -- common/autotest_common.sh@1184 -- # local i=0 00:17:01.553 00:51:08 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:17:01.553 00:51:08 -- common/autotest_common.sh@1186 -- # [[ -n 1 ]] 00:17:01.553 00:51:08 -- common/autotest_common.sh@1187 -- # nvme_device_counter=1 00:17:01.553 00:51:08 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:04.101 00:51:10 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:04.101 00:51:10 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:04.101 00:51:10 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:04.101 00:51:10 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:17:04.101 00:51:10 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:04.101 00:51:10 -- common/autotest_common.sh@1194 -- # return 0 00:17:04.101 00:51:10 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:17:04.101 00:51:10 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:17:04.101 00:51:10 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:17:04.101 00:51:10 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:17:04.101 00:51:10 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:17:04.101 00:51:10 -- common/autotest_common.sh@638 -- # local es=0 00:17:04.101 00:51:10 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:17:04.101 00:51:10 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:17:04.101 00:51:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:04.101 00:51:10 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:17:04.101 00:51:10 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:04.101 00:51:10 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:17:04.101 00:51:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.101 00:51:10 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:17:04.101 00:51:10 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.101 00:51:10 -- common/autotest_common.sh@641 -- # es=1 00:17:04.101 00:51:10 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:04.101 00:51:10 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:04.101 00:51:10 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:04.101 00:51:10 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:17:04.101 00:51:10 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.101 00:51:10 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:04.101 [ 0]:0x2 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.101 00:51:10 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:04.101 00:51:10 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.101 00:51:10 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:17:04.101 00:51:11 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:17:04.101 00:51:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.101 00:51:11 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:04.101 [ 0]:0x1 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # nguid=2c5b9f23911542b4ae8ca9225583a96f 00:17:04.101 00:51:11 -- target/ns_masking.sh@41 -- # [[ 2c5b9f23911542b4ae8ca9225583a96f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.101 00:51:11 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:17:04.101 00:51:11 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:04.101 00:51:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.101 [ 1]:0x2 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.101 00:51:11 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:04.101 00:51:11 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.101 00:51:11 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:17:04.364 00:51:11 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:17:04.364 00:51:11 -- common/autotest_common.sh@638 -- # local es=0 00:17:04.364 00:51:11 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:17:04.364 00:51:11 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:17:04.364 00:51:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:04.364 00:51:11 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:17:04.364 00:51:11 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:04.364 00:51:11 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:17:04.364 00:51:11 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:04.364 00:51:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:17:04.364 00:51:11 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.364 00:51:11 -- common/autotest_common.sh@641 -- # es=1 00:17:04.364 00:51:11 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:04.364 00:51:11 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:04.364 00:51:11 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:04.364 00:51:11 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:17:04.364 00:51:11 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:04.364 00:51:11 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:04.364 [ 0]:0x2 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:04.364 00:51:11 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:04.364 00:51:11 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:04.364 00:51:11 -- target/ns_masking.sh@91 -- # disconnect 00:17:04.364 00:51:11 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:04.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:04.623 00:51:11 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:17:04.883 00:51:11 -- target/ns_masking.sh@95 -- # connect 2 00:17:04.883 00:51:11 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 12740632-afcc-42c0-9c90-d1da358de2d5 -a 192.168.100.8 -s 4420 -i 4 00:17:05.143 00:51:12 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:17:05.143 00:51:12 -- common/autotest_common.sh@1184 -- # local i=0 00:17:05.143 00:51:12 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:17:05.143 00:51:12 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:17:05.143 00:51:12 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:17:05.143 00:51:12 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:07.057 00:51:14 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:07.057 00:51:14 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:07.057 00:51:14 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:07.057 00:51:14 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:17:07.057 00:51:14 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:07.057 00:51:14 -- common/autotest_common.sh@1194 -- # return 0 00:17:07.057 00:51:14 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:17:07.057 00:51:14 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:17:07.057 00:51:14 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:17:07.317 00:51:14 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:17:07.317 00:51:14 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:17:07.317 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.317 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:07.317 [ 0]:0x1 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # nguid=2c5b9f23911542b4ae8ca9225583a96f 00:17:07.317 00:51:14 -- target/ns_masking.sh@41 -- # [[ 2c5b9f23911542b4ae8ca9225583a96f != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.317 00:51:14 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:17:07.317 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.317 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:07.317 [ 1]:0x2 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.317 00:51:14 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:07.317 00:51:14 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.317 00:51:14 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:17:07.578 00:51:14 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:17:07.578 00:51:14 -- common/autotest_common.sh@638 -- # local es=0 00:17:07.578 00:51:14 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:17:07.578 00:51:14 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.578 00:51:14 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:17:07.578 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.578 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:17:07.578 00:51:14 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.578 00:51:14 -- common/autotest_common.sh@641 -- # es=1 00:17:07.578 00:51:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:07.578 00:51:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:07.578 00:51:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:07.578 00:51:14 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:17:07.578 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:07.578 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.578 [ 0]:0x2 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:07.578 00:51:14 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:07.578 00:51:14 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.578 00:51:14 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:17:07.578 00:51:14 -- common/autotest_common.sh@638 -- # local es=0 00:17:07.578 00:51:14 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:17:07.578 00:51:14 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.578 00:51:14 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:07.578 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.578 00:51:14 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:07.578 00:51:14 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:17:07.578 00:51:14 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:17:07.578 [2024-04-26 00:51:14.757699] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:17:07.578 request: 00:17:07.578 { 00:17:07.578 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:07.578 "nsid": 2, 00:17:07.578 "host": "nqn.2016-06.io.spdk:host1", 00:17:07.578 "method": "nvmf_ns_remove_host", 00:17:07.579 "req_id": 1 00:17:07.579 } 00:17:07.579 Got JSON-RPC error response 00:17:07.579 response: 00:17:07.579 { 00:17:07.579 "code": -32602, 00:17:07.579 "message": "Invalid parameters" 00:17:07.579 } 00:17:07.838 00:51:14 -- common/autotest_common.sh@641 -- # es=1 00:17:07.838 00:51:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:07.838 00:51:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:07.839 00:51:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:07.839 00:51:14 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:17:07.839 00:51:14 -- common/autotest_common.sh@638 -- # local es=0 00:17:07.839 00:51:14 -- common/autotest_common.sh@640 -- # valid_exec_arg ns_is_visible 0x1 00:17:07.839 00:51:14 -- common/autotest_common.sh@626 -- # local arg=ns_is_visible 00:17:07.839 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.839 00:51:14 -- common/autotest_common.sh@630 -- # type -t ns_is_visible 00:17:07.839 00:51:14 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:17:07.839 00:51:14 -- common/autotest_common.sh@641 -- # ns_is_visible 0x1 00:17:07.839 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.839 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x1 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:17:07.839 00:51:14 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.839 00:51:14 -- common/autotest_common.sh@641 -- # es=1 00:17:07.839 00:51:14 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:17:07.839 00:51:14 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:17:07.839 00:51:14 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:17:07.839 00:51:14 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:17:07.839 00:51:14 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:17:07.839 00:51:14 -- target/ns_masking.sh@39 -- # grep 0x2 00:17:07.839 [ 0]:0x2 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:17:07.839 00:51:14 -- target/ns_masking.sh@40 -- # nguid=85910aa1a5cb4b298bbcfa6c1dbd1cd8 00:17:07.839 00:51:14 -- target/ns_masking.sh@41 -- # [[ 85910aa1a5cb4b298bbcfa6c1dbd1cd8 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:17:07.839 00:51:14 -- target/ns_masking.sh@108 -- # disconnect 00:17:07.839 00:51:14 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:08.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:08.098 00:51:15 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:08.358 00:51:15 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:17:08.358 00:51:15 -- target/ns_masking.sh@114 -- # nvmftestfini 00:17:08.358 00:51:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:08.358 00:51:15 -- nvmf/common.sh@117 -- # sync 00:17:08.358 00:51:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:08.358 00:51:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:08.358 00:51:15 -- nvmf/common.sh@120 -- # set +e 00:17:08.358 00:51:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:08.358 00:51:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:08.358 rmmod nvme_rdma 00:17:08.358 rmmod nvme_fabrics 00:17:08.358 00:51:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:08.358 00:51:15 -- nvmf/common.sh@124 -- # set -e 00:17:08.358 00:51:15 -- nvmf/common.sh@125 -- # return 0 00:17:08.358 00:51:15 -- nvmf/common.sh@478 -- # '[' -n 288097 ']' 00:17:08.358 00:51:15 -- nvmf/common.sh@479 -- # killprocess 288097 00:17:08.358 00:51:15 -- common/autotest_common.sh@936 -- # '[' -z 288097 ']' 00:17:08.358 00:51:15 -- common/autotest_common.sh@940 -- # kill -0 288097 00:17:08.358 00:51:15 -- common/autotest_common.sh@941 -- # uname 00:17:08.358 00:51:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.358 00:51:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 288097 00:17:08.358 00:51:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:08.358 00:51:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:08.358 00:51:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 288097' 00:17:08.358 killing process with pid 288097 00:17:08.358 00:51:15 -- common/autotest_common.sh@955 -- # kill 288097 00:17:08.358 00:51:15 -- common/autotest_common.sh@960 -- # wait 288097 00:17:08.358 [2024-04-26 00:51:15.544686] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:08.618 00:51:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:08.618 00:51:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:08.618 00:17:08.618 real 0m17.617s 00:17:08.618 user 0m54.141s 00:17:08.618 sys 0m4.681s 00:17:08.618 00:51:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:08.618 00:51:15 -- common/autotest_common.sh@10 -- # set +x 00:17:08.618 ************************************ 00:17:08.618 END TEST nvmf_ns_masking 00:17:08.618 ************************************ 00:17:08.884 00:51:15 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:17:08.884 00:51:15 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:17:08.884 00:51:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:08.884 00:51:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.884 00:51:15 -- common/autotest_common.sh@10 -- # set +x 00:17:08.884 ************************************ 00:17:08.884 START TEST nvmf_nvme_cli 00:17:08.884 ************************************ 00:17:08.884 00:51:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:17:08.884 * Looking for test storage... 00:17:08.884 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:08.884 00:51:16 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:08.884 00:51:16 -- nvmf/common.sh@7 -- # uname -s 00:17:08.884 00:51:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:08.884 00:51:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:08.884 00:51:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:08.884 00:51:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:08.884 00:51:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:08.884 00:51:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:08.884 00:51:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:08.884 00:51:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:08.884 00:51:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:08.884 00:51:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:08.884 00:51:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:08.884 00:51:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:08.884 00:51:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:08.884 00:51:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:08.884 00:51:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:08.884 00:51:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:08.884 00:51:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:08.884 00:51:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:08.884 00:51:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:08.884 00:51:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:08.884 00:51:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.884 00:51:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.884 00:51:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.884 00:51:16 -- paths/export.sh@5 -- # export PATH 00:17:08.884 00:51:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.884 00:51:16 -- nvmf/common.sh@47 -- # : 0 00:17:08.884 00:51:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:08.884 00:51:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:08.884 00:51:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:08.884 00:51:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:08.884 00:51:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:08.884 00:51:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:08.884 00:51:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:08.884 00:51:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:08.884 00:51:16 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:08.884 00:51:16 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:08.884 00:51:16 -- target/nvme_cli.sh@14 -- # devs=() 00:17:08.884 00:51:16 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:17:08.884 00:51:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:08.884 00:51:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:08.884 00:51:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:08.884 00:51:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:08.884 00:51:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:08.884 00:51:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.884 00:51:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.884 00:51:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.884 00:51:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:08.884 00:51:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:08.884 00:51:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:08.884 00:51:16 -- common/autotest_common.sh@10 -- # set +x 00:17:14.165 00:51:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.165 00:51:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:14.165 00:51:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:14.165 00:51:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:14.165 00:51:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:14.165 00:51:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:14.165 00:51:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:14.165 00:51:21 -- nvmf/common.sh@295 -- # net_devs=() 00:17:14.165 00:51:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:14.165 00:51:21 -- nvmf/common.sh@296 -- # e810=() 00:17:14.165 00:51:21 -- nvmf/common.sh@296 -- # local -ga e810 00:17:14.165 00:51:21 -- nvmf/common.sh@297 -- # x722=() 00:17:14.165 00:51:21 -- nvmf/common.sh@297 -- # local -ga x722 00:17:14.165 00:51:21 -- nvmf/common.sh@298 -- # mlx=() 00:17:14.165 00:51:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:14.165 00:51:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.165 00:51:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:14.165 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:14.165 00:51:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:14.165 00:51:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:14.165 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:14.165 00:51:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:14.165 00:51:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.165 00:51:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.165 00:51:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:14.165 Found net devices under 0000:18:00.0: mlx_0_0 00:17:14.165 00:51:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.165 00:51:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.165 00:51:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:14.165 Found net devices under 0000:18:00.1: mlx_0_1 00:17:14.165 00:51:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.165 00:51:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:14.165 00:51:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:14.165 00:51:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:14.165 00:51:21 -- nvmf/common.sh@58 -- # uname 00:17:14.165 00:51:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:14.165 00:51:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:14.165 00:51:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:14.165 00:51:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:14.165 00:51:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:14.165 00:51:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:14.165 00:51:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:14.165 00:51:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:14.165 00:51:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:14.165 00:51:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:14.165 00:51:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:14.165 00:51:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:14.165 00:51:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:14.165 00:51:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:14.165 00:51:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:14.165 00:51:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:14.165 00:51:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:14.165 00:51:21 -- nvmf/common.sh@105 -- # continue 2 00:17:14.165 00:51:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.165 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:14.165 00:51:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:14.165 00:51:21 -- nvmf/common.sh@105 -- # continue 2 00:17:14.165 00:51:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:14.166 00:51:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.166 00:51:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:14.166 00:51:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:14.166 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:14.166 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:14.166 altname enp24s0f0np0 00:17:14.166 altname ens785f0np0 00:17:14.166 inet 192.168.100.8/24 scope global mlx_0_0 00:17:14.166 valid_lft forever preferred_lft forever 00:17:14.166 00:51:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:14.166 00:51:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.166 00:51:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:14.166 00:51:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:14.166 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:14.166 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:14.166 altname enp24s0f1np1 00:17:14.166 altname ens785f1np1 00:17:14.166 inet 192.168.100.9/24 scope global mlx_0_1 00:17:14.166 valid_lft forever preferred_lft forever 00:17:14.166 00:51:21 -- nvmf/common.sh@411 -- # return 0 00:17:14.166 00:51:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:14.166 00:51:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:14.166 00:51:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:14.166 00:51:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:14.166 00:51:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:14.166 00:51:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:14.166 00:51:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:14.166 00:51:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:14.166 00:51:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:14.166 00:51:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.166 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.166 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@105 -- # continue 2 00:17:14.166 00:51:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:14.166 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.166 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:14.166 00:51:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:14.166 00:51:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@105 -- # continue 2 00:17:14.166 00:51:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:14.166 00:51:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.166 00:51:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:14.166 00:51:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:14.166 00:51:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:14.166 00:51:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:14.166 192.168.100.9' 00:17:14.166 00:51:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:14.166 192.168.100.9' 00:17:14.166 00:51:21 -- nvmf/common.sh@446 -- # head -n 1 00:17:14.426 00:51:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:14.426 00:51:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:14.426 192.168.100.9' 00:17:14.426 00:51:21 -- nvmf/common.sh@447 -- # tail -n +2 00:17:14.426 00:51:21 -- nvmf/common.sh@447 -- # head -n 1 00:17:14.426 00:51:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:14.426 00:51:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:14.426 00:51:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:14.426 00:51:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:14.426 00:51:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:14.426 00:51:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:14.426 00:51:21 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:17:14.426 00:51:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:14.426 00:51:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:14.426 00:51:21 -- common/autotest_common.sh@10 -- # set +x 00:17:14.426 00:51:21 -- nvmf/common.sh@470 -- # nvmfpid=294365 00:17:14.426 00:51:21 -- nvmf/common.sh@471 -- # waitforlisten 294365 00:17:14.426 00:51:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:14.426 00:51:21 -- common/autotest_common.sh@817 -- # '[' -z 294365 ']' 00:17:14.426 00:51:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.426 00:51:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:14.426 00:51:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.426 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.426 00:51:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:14.426 00:51:21 -- common/autotest_common.sh@10 -- # set +x 00:17:14.426 [2024-04-26 00:51:21.443233] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:14.426 [2024-04-26 00:51:21.443280] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:14.426 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.426 [2024-04-26 00:51:21.496626] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:14.426 [2024-04-26 00:51:21.566718] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.426 [2024-04-26 00:51:21.566754] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.426 [2024-04-26 00:51:21.566760] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:14.426 [2024-04-26 00:51:21.566766] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:14.426 [2024-04-26 00:51:21.566770] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.426 [2024-04-26 00:51:21.566817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:14.426 [2024-04-26 00:51:21.566830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.426 [2024-04-26 00:51:21.566903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:14.426 [2024-04-26 00:51:21.566904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:15.365 00:51:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:15.365 00:51:22 -- common/autotest_common.sh@850 -- # return 0 00:17:15.365 00:51:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:15.365 00:51:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:15.365 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.365 00:51:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.365 00:51:22 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:15.365 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.365 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.365 [2024-04-26 00:51:22.282525] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1d31880/0x1d35d70) succeed. 00:17:15.365 [2024-04-26 00:51:22.291611] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1d32ec0/0x1d77400) succeed. 00:17:15.365 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.365 00:51:22 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:15.365 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.365 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.365 Malloc0 00:17:15.365 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.365 00:51:22 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:17:15.365 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.365 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.365 Malloc1 00:17:15.365 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.365 00:51:22 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:17:15.365 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.365 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.365 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.366 00:51:22 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:15.366 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.366 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.366 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.366 00:51:22 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:15.366 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.366 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.366 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.366 00:51:22 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:17:15.366 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.366 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.366 [2024-04-26 00:51:22.476455] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:15.366 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.366 00:51:22 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:15.366 00:51:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:15.366 00:51:22 -- common/autotest_common.sh@10 -- # set +x 00:17:15.366 00:51:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:15.366 00:51:22 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:17:15.625 00:17:15.625 Discovery Log Number of Records 2, Generation counter 2 00:17:15.625 =====Discovery Log Entry 0====== 00:17:15.625 trtype: rdma 00:17:15.625 adrfam: ipv4 00:17:15.625 subtype: current discovery subsystem 00:17:15.625 treq: not required 00:17:15.625 portid: 0 00:17:15.625 trsvcid: 4420 00:17:15.625 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:17:15.625 traddr: 192.168.100.8 00:17:15.625 eflags: explicit discovery connections, duplicate discovery information 00:17:15.625 rdma_prtype: not specified 00:17:15.625 rdma_qptype: connected 00:17:15.625 rdma_cms: rdma-cm 00:17:15.625 rdma_pkey: 0x0000 00:17:15.625 =====Discovery Log Entry 1====== 00:17:15.625 trtype: rdma 00:17:15.625 adrfam: ipv4 00:17:15.625 subtype: nvme subsystem 00:17:15.625 treq: not required 00:17:15.625 portid: 0 00:17:15.625 trsvcid: 4420 00:17:15.625 subnqn: nqn.2016-06.io.spdk:cnode1 00:17:15.625 traddr: 192.168.100.8 00:17:15.625 eflags: none 00:17:15.625 rdma_prtype: not specified 00:17:15.625 rdma_qptype: connected 00:17:15.625 rdma_cms: rdma-cm 00:17:15.625 rdma_pkey: 0x0000 00:17:15.625 00:51:22 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:17:15.625 00:51:22 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:17:15.625 00:51:22 -- nvmf/common.sh@511 -- # local dev _ 00:17:15.625 00:51:22 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:15.625 00:51:22 -- nvmf/common.sh@510 -- # nvme list 00:17:15.625 00:51:22 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:17:15.625 00:51:22 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:15.625 00:51:22 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:17:15.625 00:51:22 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:15.625 00:51:22 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:17:15.625 00:51:22 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:17:16.561 00:51:23 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:17:16.561 00:51:23 -- common/autotest_common.sh@1184 -- # local i=0 00:17:16.561 00:51:23 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:17:16.561 00:51:23 -- common/autotest_common.sh@1186 -- # [[ -n 2 ]] 00:17:16.561 00:51:23 -- common/autotest_common.sh@1187 -- # nvme_device_counter=2 00:17:16.561 00:51:23 -- common/autotest_common.sh@1191 -- # sleep 2 00:17:18.469 00:51:25 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:17:18.469 00:51:25 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:17:18.469 00:51:25 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:17:18.469 00:51:25 -- common/autotest_common.sh@1193 -- # nvme_devices=2 00:17:18.469 00:51:25 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:17:18.469 00:51:25 -- common/autotest_common.sh@1194 -- # return 0 00:17:18.469 00:51:25 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:17:18.469 00:51:25 -- nvmf/common.sh@511 -- # local dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@510 -- # nvme list 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:17:18.469 /dev/nvme0n1 ]] 00:17:18.469 00:51:25 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:17:18.469 00:51:25 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:17:18.469 00:51:25 -- nvmf/common.sh@511 -- # local dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@510 -- # nvme list 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:17:18.469 00:51:25 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:17:18.469 00:51:25 -- nvmf/common.sh@513 -- # read -r dev _ 00:17:18.469 00:51:25 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:17:18.469 00:51:25 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:19.409 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:19.409 00:51:26 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:19.409 00:51:26 -- common/autotest_common.sh@1205 -- # local i=0 00:17:19.409 00:51:26 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:17:19.409 00:51:26 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:19.409 00:51:26 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:17:19.409 00:51:26 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:19.409 00:51:26 -- common/autotest_common.sh@1217 -- # return 0 00:17:19.409 00:51:26 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:17:19.409 00:51:26 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:19.409 00:51:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:19.409 00:51:26 -- common/autotest_common.sh@10 -- # set +x 00:17:19.409 00:51:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:19.409 00:51:26 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:17:19.409 00:51:26 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:17:19.409 00:51:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:19.409 00:51:26 -- nvmf/common.sh@117 -- # sync 00:17:19.409 00:51:26 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:19.409 00:51:26 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:19.409 00:51:26 -- nvmf/common.sh@120 -- # set +e 00:17:19.409 00:51:26 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:19.409 00:51:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:19.669 rmmod nvme_rdma 00:17:19.669 rmmod nvme_fabrics 00:17:19.669 00:51:26 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:19.669 00:51:26 -- nvmf/common.sh@124 -- # set -e 00:17:19.669 00:51:26 -- nvmf/common.sh@125 -- # return 0 00:17:19.669 00:51:26 -- nvmf/common.sh@478 -- # '[' -n 294365 ']' 00:17:19.669 00:51:26 -- nvmf/common.sh@479 -- # killprocess 294365 00:17:19.670 00:51:26 -- common/autotest_common.sh@936 -- # '[' -z 294365 ']' 00:17:19.670 00:51:26 -- common/autotest_common.sh@940 -- # kill -0 294365 00:17:19.670 00:51:26 -- common/autotest_common.sh@941 -- # uname 00:17:19.670 00:51:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:19.670 00:51:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 294365 00:17:19.670 00:51:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:19.670 00:51:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:19.670 00:51:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 294365' 00:17:19.670 killing process with pid 294365 00:17:19.670 00:51:26 -- common/autotest_common.sh@955 -- # kill 294365 00:17:19.670 00:51:26 -- common/autotest_common.sh@960 -- # wait 294365 00:17:19.670 [2024-04-26 00:51:26.762359] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:19.929 00:51:26 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:19.929 00:51:26 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:19.929 00:17:19.929 real 0m11.056s 00:17:19.929 user 0m22.944s 00:17:19.929 sys 0m4.562s 00:17:19.929 00:51:26 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:19.929 00:51:26 -- common/autotest_common.sh@10 -- # set +x 00:17:19.929 ************************************ 00:17:19.929 END TEST nvmf_nvme_cli 00:17:19.929 ************************************ 00:17:19.929 00:51:27 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:17:19.929 00:51:27 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:17:19.929 00:51:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:19.929 00:51:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:19.929 00:51:27 -- common/autotest_common.sh@10 -- # set +x 00:17:20.189 ************************************ 00:17:20.189 START TEST nvmf_host_management 00:17:20.189 ************************************ 00:17:20.189 00:51:27 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:17:20.189 * Looking for test storage... 00:17:20.189 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:20.189 00:51:27 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:20.189 00:51:27 -- nvmf/common.sh@7 -- # uname -s 00:17:20.189 00:51:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:20.189 00:51:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:20.189 00:51:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:20.189 00:51:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:20.189 00:51:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:20.189 00:51:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:20.189 00:51:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:20.189 00:51:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:20.189 00:51:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:20.189 00:51:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:20.189 00:51:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:20.189 00:51:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:20.189 00:51:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:20.189 00:51:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:20.189 00:51:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:20.189 00:51:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:20.189 00:51:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:20.189 00:51:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:20.189 00:51:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:20.189 00:51:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:20.189 00:51:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.189 00:51:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.189 00:51:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.189 00:51:27 -- paths/export.sh@5 -- # export PATH 00:17:20.189 00:51:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.189 00:51:27 -- nvmf/common.sh@47 -- # : 0 00:17:20.189 00:51:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:20.189 00:51:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:20.189 00:51:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:20.189 00:51:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:20.190 00:51:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:20.190 00:51:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:20.190 00:51:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:20.190 00:51:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:20.190 00:51:27 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:20.190 00:51:27 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:20.190 00:51:27 -- target/host_management.sh@105 -- # nvmftestinit 00:17:20.190 00:51:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:20.190 00:51:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:20.190 00:51:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:20.190 00:51:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:20.190 00:51:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:20.190 00:51:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:20.190 00:51:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:20.190 00:51:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.190 00:51:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:20.190 00:51:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:20.190 00:51:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:20.190 00:51:27 -- common/autotest_common.sh@10 -- # set +x 00:17:25.470 00:51:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:25.470 00:51:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:25.470 00:51:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:25.470 00:51:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:25.470 00:51:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:25.470 00:51:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:25.470 00:51:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:25.470 00:51:32 -- nvmf/common.sh@295 -- # net_devs=() 00:17:25.470 00:51:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:25.470 00:51:32 -- nvmf/common.sh@296 -- # e810=() 00:17:25.470 00:51:32 -- nvmf/common.sh@296 -- # local -ga e810 00:17:25.470 00:51:32 -- nvmf/common.sh@297 -- # x722=() 00:17:25.470 00:51:32 -- nvmf/common.sh@297 -- # local -ga x722 00:17:25.470 00:51:32 -- nvmf/common.sh@298 -- # mlx=() 00:17:25.470 00:51:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:25.470 00:51:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:25.470 00:51:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:25.470 00:51:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:25.470 00:51:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:25.470 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:25.470 00:51:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:25.470 00:51:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:25.470 00:51:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:25.470 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:25.470 00:51:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:25.470 00:51:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:25.470 00:51:32 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:25.470 00:51:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:25.470 00:51:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:25.470 00:51:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:25.470 00:51:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:25.470 Found net devices under 0000:18:00.0: mlx_0_0 00:17:25.470 00:51:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:25.470 00:51:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:25.470 00:51:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:25.470 00:51:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:25.470 00:51:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:25.470 Found net devices under 0000:18:00.1: mlx_0_1 00:17:25.470 00:51:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:25.470 00:51:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:25.470 00:51:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:25.470 00:51:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:25.470 00:51:32 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:25.470 00:51:32 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:25.470 00:51:32 -- nvmf/common.sh@58 -- # uname 00:17:25.470 00:51:32 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:25.470 00:51:32 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:25.470 00:51:32 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:25.470 00:51:32 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:25.470 00:51:32 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:25.470 00:51:32 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:25.470 00:51:32 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:25.470 00:51:32 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:25.470 00:51:32 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:25.470 00:51:32 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:25.470 00:51:32 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:25.470 00:51:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:25.470 00:51:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:25.470 00:51:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:25.471 00:51:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:25.471 00:51:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:25.471 00:51:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@105 -- # continue 2 00:17:25.471 00:51:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@105 -- # continue 2 00:17:25.471 00:51:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:25.471 00:51:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:25.471 00:51:32 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:25.471 00:51:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:25.471 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:25.471 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:25.471 altname enp24s0f0np0 00:17:25.471 altname ens785f0np0 00:17:25.471 inet 192.168.100.8/24 scope global mlx_0_0 00:17:25.471 valid_lft forever preferred_lft forever 00:17:25.471 00:51:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:25.471 00:51:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:25.471 00:51:32 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:25.471 00:51:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:25.471 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:25.471 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:25.471 altname enp24s0f1np1 00:17:25.471 altname ens785f1np1 00:17:25.471 inet 192.168.100.9/24 scope global mlx_0_1 00:17:25.471 valid_lft forever preferred_lft forever 00:17:25.471 00:51:32 -- nvmf/common.sh@411 -- # return 0 00:17:25.471 00:51:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:25.471 00:51:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:25.471 00:51:32 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:25.471 00:51:32 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:25.471 00:51:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:25.471 00:51:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:25.471 00:51:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:25.471 00:51:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:25.471 00:51:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:25.471 00:51:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@105 -- # continue 2 00:17:25.471 00:51:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:25.471 00:51:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:25.471 00:51:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@105 -- # continue 2 00:17:25.471 00:51:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:25.471 00:51:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:25.471 00:51:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:25.471 00:51:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:25.471 00:51:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:25.471 00:51:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:25.471 192.168.100.9' 00:17:25.471 00:51:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:25.471 192.168.100.9' 00:17:25.471 00:51:32 -- nvmf/common.sh@446 -- # head -n 1 00:17:25.471 00:51:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:25.471 00:51:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:25.471 192.168.100.9' 00:17:25.471 00:51:32 -- nvmf/common.sh@447 -- # tail -n +2 00:17:25.471 00:51:32 -- nvmf/common.sh@447 -- # head -n 1 00:17:25.471 00:51:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:25.471 00:51:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:25.471 00:51:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:25.471 00:51:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:25.471 00:51:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:25.471 00:51:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:25.730 00:51:32 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:17:25.730 00:51:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:25.730 00:51:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:25.730 00:51:32 -- common/autotest_common.sh@10 -- # set +x 00:17:25.730 ************************************ 00:17:25.730 START TEST nvmf_host_management 00:17:25.730 ************************************ 00:17:25.730 00:51:32 -- common/autotest_common.sh@1111 -- # nvmf_host_management 00:17:25.730 00:51:32 -- target/host_management.sh@69 -- # starttarget 00:17:25.730 00:51:32 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:25.730 00:51:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:25.730 00:51:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:25.730 00:51:32 -- common/autotest_common.sh@10 -- # set +x 00:17:25.730 00:51:32 -- nvmf/common.sh@470 -- # nvmfpid=298718 00:17:25.730 00:51:32 -- nvmf/common.sh@471 -- # waitforlisten 298718 00:17:25.730 00:51:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:25.730 00:51:32 -- common/autotest_common.sh@817 -- # '[' -z 298718 ']' 00:17:25.730 00:51:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:25.730 00:51:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:25.730 00:51:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:25.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:25.730 00:51:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:25.730 00:51:32 -- common/autotest_common.sh@10 -- # set +x 00:17:25.730 [2024-04-26 00:51:32.852576] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:25.730 [2024-04-26 00:51:32.852610] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:25.730 EAL: No free 2048 kB hugepages reported on node 1 00:17:25.730 [2024-04-26 00:51:32.901967] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:25.988 [2024-04-26 00:51:32.971918] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:25.988 [2024-04-26 00:51:32.971952] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:25.988 [2024-04-26 00:51:32.971958] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:25.988 [2024-04-26 00:51:32.971964] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:25.988 [2024-04-26 00:51:32.971968] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:25.988 [2024-04-26 00:51:32.972064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:25.988 [2024-04-26 00:51:32.972135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:25.988 [2024-04-26 00:51:32.972244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:25.988 [2024-04-26 00:51:32.972258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:26.556 00:51:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:26.556 00:51:33 -- common/autotest_common.sh@850 -- # return 0 00:17:26.556 00:51:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:26.556 00:51:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:26.556 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.556 00:51:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:26.556 00:51:33 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:26.556 00:51:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:26.556 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.556 [2024-04-26 00:51:33.685694] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x205eb70/0x2063060) succeed. 00:17:26.556 [2024-04-26 00:51:33.694886] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x20601b0/0x20a46f0) succeed. 00:17:26.816 00:51:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:26.816 00:51:33 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:26.816 00:51:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:26.816 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.816 00:51:33 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:26.816 00:51:33 -- target/host_management.sh@23 -- # cat 00:17:26.816 00:51:33 -- target/host_management.sh@30 -- # rpc_cmd 00:17:26.816 00:51:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:26.816 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.816 Malloc0 00:17:26.816 [2024-04-26 00:51:33.857907] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:26.816 00:51:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:26.816 00:51:33 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:26.816 00:51:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:26.816 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.816 00:51:33 -- target/host_management.sh@73 -- # perfpid=298847 00:17:26.816 00:51:33 -- target/host_management.sh@74 -- # waitforlisten 298847 /var/tmp/bdevperf.sock 00:17:26.816 00:51:33 -- common/autotest_common.sh@817 -- # '[' -z 298847 ']' 00:17:26.816 00:51:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:26.816 00:51:33 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:26.816 00:51:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:26.816 00:51:33 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:26.816 00:51:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:26.816 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:26.816 00:51:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:26.816 00:51:33 -- nvmf/common.sh@521 -- # config=() 00:17:26.816 00:51:33 -- common/autotest_common.sh@10 -- # set +x 00:17:26.816 00:51:33 -- nvmf/common.sh@521 -- # local subsystem config 00:17:26.816 00:51:33 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:26.816 00:51:33 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:26.816 { 00:17:26.816 "params": { 00:17:26.816 "name": "Nvme$subsystem", 00:17:26.816 "trtype": "$TEST_TRANSPORT", 00:17:26.816 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:26.816 "adrfam": "ipv4", 00:17:26.816 "trsvcid": "$NVMF_PORT", 00:17:26.816 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:26.816 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:26.816 "hdgst": ${hdgst:-false}, 00:17:26.816 "ddgst": ${ddgst:-false} 00:17:26.816 }, 00:17:26.816 "method": "bdev_nvme_attach_controller" 00:17:26.816 } 00:17:26.816 EOF 00:17:26.816 )") 00:17:26.816 00:51:33 -- nvmf/common.sh@543 -- # cat 00:17:26.816 00:51:33 -- nvmf/common.sh@545 -- # jq . 00:17:26.816 00:51:33 -- nvmf/common.sh@546 -- # IFS=, 00:17:26.816 00:51:33 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:26.816 "params": { 00:17:26.816 "name": "Nvme0", 00:17:26.816 "trtype": "rdma", 00:17:26.816 "traddr": "192.168.100.8", 00:17:26.816 "adrfam": "ipv4", 00:17:26.816 "trsvcid": "4420", 00:17:26.816 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:26.816 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:26.816 "hdgst": false, 00:17:26.816 "ddgst": false 00:17:26.816 }, 00:17:26.816 "method": "bdev_nvme_attach_controller" 00:17:26.816 }' 00:17:26.816 [2024-04-26 00:51:33.947329] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:26.816 [2024-04-26 00:51:33.947373] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid298847 ] 00:17:26.816 EAL: No free 2048 kB hugepages reported on node 1 00:17:26.816 [2024-04-26 00:51:33.997398] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.076 [2024-04-26 00:51:34.063470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:27.076 Running I/O for 10 seconds... 00:17:27.645 00:51:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:27.645 00:51:34 -- common/autotest_common.sh@850 -- # return 0 00:17:27.645 00:51:34 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:27.645 00:51:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:27.645 00:51:34 -- common/autotest_common.sh@10 -- # set +x 00:17:27.645 00:51:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:27.645 00:51:34 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:27.645 00:51:34 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:27.645 00:51:34 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:27.645 00:51:34 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:27.645 00:51:34 -- target/host_management.sh@52 -- # local ret=1 00:17:27.645 00:51:34 -- target/host_management.sh@53 -- # local i 00:17:27.645 00:51:34 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:27.645 00:51:34 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:27.645 00:51:34 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:27.645 00:51:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:27.645 00:51:34 -- common/autotest_common.sh@10 -- # set +x 00:17:27.645 00:51:34 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:27.645 00:51:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:27.645 00:51:34 -- target/host_management.sh@55 -- # read_io_count=1708 00:17:27.645 00:51:34 -- target/host_management.sh@58 -- # '[' 1708 -ge 100 ']' 00:17:27.645 00:51:34 -- target/host_management.sh@59 -- # ret=0 00:17:27.645 00:51:34 -- target/host_management.sh@60 -- # break 00:17:27.645 00:51:34 -- target/host_management.sh@64 -- # return 0 00:17:27.645 00:51:34 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:27.645 00:51:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:27.645 00:51:34 -- common/autotest_common.sh@10 -- # set +x 00:17:27.645 00:51:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:27.645 00:51:34 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:27.645 00:51:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:17:27.645 00:51:34 -- common/autotest_common.sh@10 -- # set +x 00:17:27.645 00:51:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:17:27.645 00:51:34 -- target/host_management.sh@87 -- # sleep 1 00:17:29.028 [2024-04-26 00:51:35.812468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:106496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:106624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:106752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:106880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:107008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:107136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:107264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:107392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:107520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:107648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:107776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:107904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:108032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:108160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:17:29.028 [2024-04-26 00:51:35.812689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:108288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192d1e80 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:108416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192c1e00 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:108544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192b1d80 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:108672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192a1d00 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:108800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019291c80 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:108928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019281c00 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:109056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019271b80 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:109184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019261b00 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:109312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019251a80 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:109440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019241a00 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:109568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019231980 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:109696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019221900 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:109824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019211880 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:109952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019201800 len:0x10000 key:0x182800 00:17:29.028 [2024-04-26 00:51:35.812880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:110080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:17:29.028 [2024-04-26 00:51:35.812893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.028 [2024-04-26 00:51:35.812900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:110208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:17:29.028 [2024-04-26 00:51:35.812906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:110336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:110464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:110592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:110720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:110848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:110976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.812990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.812997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:111104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.813003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:111232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.813016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:111360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.813029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:111488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.813042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:111616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001902f980 len:0x10000 key:0x182700 00:17:29.029 [2024-04-26 00:51:35.813055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:103552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e74e000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:103680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e76f000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:103808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e11e000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:103936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e13f000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:104064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000daee000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:104192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000db0f000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:104320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d4be000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:104448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d4df000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:104576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ce8e000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:104704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eb8f000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:104832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eb6e000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:104960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eb4d000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:105088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eb2c000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:105216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eb0b000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:105344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eaea000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:105472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000eac9000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:105600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ea66000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:105728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ea45000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:105856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ea24000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:105984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ea03000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:106112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e9e2000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:106240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e9c1000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.813360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:106368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000e9a0000 len:0x10000 key:0x182400 00:17:29.029 [2024-04-26 00:51:35.813366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:17:29.029 [2024-04-26 00:51:35.815255] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:17:29.029 [2024-04-26 00:51:35.816083] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:29.029 task offset: 106496 on job bdev=Nvme0n1 fails 00:17:29.029 00:17:29.029 Latency(us) 00:17:29.029 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:29.029 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:29.029 Job: Nvme0n1 ended in about 1.57 seconds with error 00:17:29.029 Verification LBA range: start 0x0 length 0x400 00:17:29.029 Nvme0n1 : 1.57 1167.93 73.00 40.78 0.00 52476.01 1905.40 1019060.53 00:17:29.030 =================================================================================================================== 00:17:29.030 Total : 1167.93 73.00 40.78 0.00 52476.01 1905.40 1019060.53 00:17:29.030 [2024-04-26 00:51:35.817625] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:29.030 00:51:35 -- target/host_management.sh@91 -- # kill -9 298847 00:17:29.030 00:51:35 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:29.030 00:51:35 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:29.030 00:51:35 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:29.030 00:51:35 -- nvmf/common.sh@521 -- # config=() 00:17:29.030 00:51:35 -- nvmf/common.sh@521 -- # local subsystem config 00:17:29.030 00:51:35 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:17:29.030 00:51:35 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:17:29.030 { 00:17:29.030 "params": { 00:17:29.030 "name": "Nvme$subsystem", 00:17:29.030 "trtype": "$TEST_TRANSPORT", 00:17:29.030 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:29.030 "adrfam": "ipv4", 00:17:29.030 "trsvcid": "$NVMF_PORT", 00:17:29.030 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:29.030 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:29.030 "hdgst": ${hdgst:-false}, 00:17:29.030 "ddgst": ${ddgst:-false} 00:17:29.030 }, 00:17:29.030 "method": "bdev_nvme_attach_controller" 00:17:29.030 } 00:17:29.030 EOF 00:17:29.030 )") 00:17:29.030 00:51:35 -- nvmf/common.sh@543 -- # cat 00:17:29.030 00:51:35 -- nvmf/common.sh@545 -- # jq . 00:17:29.030 00:51:35 -- nvmf/common.sh@546 -- # IFS=, 00:17:29.030 00:51:35 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:17:29.030 "params": { 00:17:29.030 "name": "Nvme0", 00:17:29.030 "trtype": "rdma", 00:17:29.030 "traddr": "192.168.100.8", 00:17:29.030 "adrfam": "ipv4", 00:17:29.030 "trsvcid": "4420", 00:17:29.030 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:29.030 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:29.030 "hdgst": false, 00:17:29.030 "ddgst": false 00:17:29.030 }, 00:17:29.030 "method": "bdev_nvme_attach_controller" 00:17:29.030 }' 00:17:29.030 [2024-04-26 00:51:35.872650] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:29.030 [2024-04-26 00:51:35.872693] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid299298 ] 00:17:29.030 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.030 [2024-04-26 00:51:35.922120] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:29.030 [2024-04-26 00:51:35.988136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:29.030 Running I/O for 1 seconds... 00:17:30.408 00:17:30.408 Latency(us) 00:17:30.408 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:30.408 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:30.408 Verification LBA range: start 0x0 length 0x400 00:17:30.408 Nvme0n1 : 1.01 3340.07 208.75 0.00 0.00 18780.27 603.78 31457.28 00:17:30.408 =================================================================================================================== 00:17:30.408 Total : 3340.07 208.75 0.00 0.00 18780.27 603.78 31457.28 00:17:30.408 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 298847 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:17:30.408 00:51:37 -- target/host_management.sh@102 -- # stoptarget 00:17:30.408 00:51:37 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:30.408 00:51:37 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:30.408 00:51:37 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:30.408 00:51:37 -- target/host_management.sh@40 -- # nvmftestfini 00:17:30.408 00:51:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:30.408 00:51:37 -- nvmf/common.sh@117 -- # sync 00:17:30.408 00:51:37 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:30.408 00:51:37 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:30.408 00:51:37 -- nvmf/common.sh@120 -- # set +e 00:17:30.408 00:51:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:30.408 00:51:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:30.408 rmmod nvme_rdma 00:17:30.408 rmmod nvme_fabrics 00:17:30.408 00:51:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:30.408 00:51:37 -- nvmf/common.sh@124 -- # set -e 00:17:30.408 00:51:37 -- nvmf/common.sh@125 -- # return 0 00:17:30.408 00:51:37 -- nvmf/common.sh@478 -- # '[' -n 298718 ']' 00:17:30.408 00:51:37 -- nvmf/common.sh@479 -- # killprocess 298718 00:17:30.408 00:51:37 -- common/autotest_common.sh@936 -- # '[' -z 298718 ']' 00:17:30.408 00:51:37 -- common/autotest_common.sh@940 -- # kill -0 298718 00:17:30.408 00:51:37 -- common/autotest_common.sh@941 -- # uname 00:17:30.408 00:51:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:30.408 00:51:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 298718 00:17:30.408 00:51:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:30.408 00:51:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:30.408 00:51:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 298718' 00:17:30.408 killing process with pid 298718 00:17:30.408 00:51:37 -- common/autotest_common.sh@955 -- # kill 298718 00:17:30.408 00:51:37 -- common/autotest_common.sh@960 -- # wait 298718 00:17:30.408 [2024-04-26 00:51:37.564961] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:30.667 [2024-04-26 00:51:37.761521] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:30.667 00:51:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:30.667 00:51:37 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:30.667 00:17:30.667 real 0m4.976s 00:17:30.667 user 0m22.455s 00:17:30.667 sys 0m0.798s 00:17:30.667 00:51:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:30.667 00:51:37 -- common/autotest_common.sh@10 -- # set +x 00:17:30.667 ************************************ 00:17:30.667 END TEST nvmf_host_management 00:17:30.667 ************************************ 00:17:30.667 00:51:37 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:17:30.667 00:17:30.667 real 0m10.655s 00:17:30.667 user 0m24.095s 00:17:30.667 sys 0m4.976s 00:17:30.667 00:51:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:30.667 00:51:37 -- common/autotest_common.sh@10 -- # set +x 00:17:30.667 ************************************ 00:17:30.667 END TEST nvmf_host_management 00:17:30.667 ************************************ 00:17:30.667 00:51:37 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:30.667 00:51:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:30.667 00:51:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:30.667 00:51:37 -- common/autotest_common.sh@10 -- # set +x 00:17:30.926 ************************************ 00:17:30.926 START TEST nvmf_lvol 00:17:30.926 ************************************ 00:17:30.926 00:51:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:17:30.926 * Looking for test storage... 00:17:30.926 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:30.926 00:51:38 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:30.926 00:51:38 -- nvmf/common.sh@7 -- # uname -s 00:17:30.926 00:51:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:30.926 00:51:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:30.926 00:51:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:30.926 00:51:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:30.926 00:51:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:30.926 00:51:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:30.926 00:51:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:30.926 00:51:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:30.926 00:51:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:30.926 00:51:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:30.926 00:51:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:30.926 00:51:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:30.926 00:51:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:30.926 00:51:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:30.926 00:51:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:30.926 00:51:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:30.926 00:51:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:30.926 00:51:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:30.926 00:51:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:30.926 00:51:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:30.926 00:51:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.926 00:51:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.926 00:51:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.926 00:51:38 -- paths/export.sh@5 -- # export PATH 00:17:30.926 00:51:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.926 00:51:38 -- nvmf/common.sh@47 -- # : 0 00:17:30.926 00:51:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:30.926 00:51:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:30.926 00:51:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:30.926 00:51:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:30.926 00:51:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:30.927 00:51:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:30.927 00:51:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:30.927 00:51:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:30.927 00:51:38 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:30.927 00:51:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:30.927 00:51:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:30.927 00:51:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:30.927 00:51:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:30.927 00:51:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:30.927 00:51:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:30.927 00:51:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:30.927 00:51:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.927 00:51:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:30.927 00:51:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:30.927 00:51:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:30.927 00:51:38 -- common/autotest_common.sh@10 -- # set +x 00:17:36.207 00:51:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:36.207 00:51:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:36.207 00:51:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:36.207 00:51:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:36.207 00:51:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:36.207 00:51:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:36.207 00:51:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:36.207 00:51:43 -- nvmf/common.sh@295 -- # net_devs=() 00:17:36.207 00:51:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:36.207 00:51:43 -- nvmf/common.sh@296 -- # e810=() 00:17:36.207 00:51:43 -- nvmf/common.sh@296 -- # local -ga e810 00:17:36.207 00:51:43 -- nvmf/common.sh@297 -- # x722=() 00:17:36.207 00:51:43 -- nvmf/common.sh@297 -- # local -ga x722 00:17:36.207 00:51:43 -- nvmf/common.sh@298 -- # mlx=() 00:17:36.207 00:51:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:36.207 00:51:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:36.207 00:51:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:36.207 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:36.207 00:51:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:36.207 00:51:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:36.207 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:36.207 00:51:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:36.207 00:51:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:36.207 00:51:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:36.207 00:51:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:36.207 Found net devices under 0000:18:00.0: mlx_0_0 00:17:36.207 00:51:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:36.207 00:51:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:36.207 00:51:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:36.207 Found net devices under 0000:18:00.1: mlx_0_1 00:17:36.207 00:51:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:36.207 00:51:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:36.207 00:51:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:36.207 00:51:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:36.207 00:51:43 -- nvmf/common.sh@58 -- # uname 00:17:36.207 00:51:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:36.207 00:51:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:36.207 00:51:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:36.207 00:51:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:36.207 00:51:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:36.207 00:51:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:36.207 00:51:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:36.207 00:51:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:36.207 00:51:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:36.207 00:51:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:36.207 00:51:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:36.207 00:51:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:36.207 00:51:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:36.207 00:51:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:36.207 00:51:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:36.207 00:51:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:36.207 00:51:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:36.207 00:51:43 -- nvmf/common.sh@105 -- # continue 2 00:17:36.207 00:51:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.207 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:36.207 00:51:43 -- nvmf/common.sh@105 -- # continue 2 00:17:36.207 00:51:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:36.207 00:51:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:36.207 00:51:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:36.207 00:51:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:36.207 00:51:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:36.207 00:51:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:36.207 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:36.207 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:36.207 altname enp24s0f0np0 00:17:36.207 altname ens785f0np0 00:17:36.207 inet 192.168.100.8/24 scope global mlx_0_0 00:17:36.207 valid_lft forever preferred_lft forever 00:17:36.207 00:51:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:36.207 00:51:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:36.207 00:51:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:36.207 00:51:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:36.208 00:51:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:36.208 00:51:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:36.208 00:51:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:36.208 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:36.208 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:36.208 altname enp24s0f1np1 00:17:36.208 altname ens785f1np1 00:17:36.208 inet 192.168.100.9/24 scope global mlx_0_1 00:17:36.208 valid_lft forever preferred_lft forever 00:17:36.208 00:51:43 -- nvmf/common.sh@411 -- # return 0 00:17:36.208 00:51:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:36.208 00:51:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:36.208 00:51:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:36.208 00:51:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:36.208 00:51:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:36.208 00:51:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:36.208 00:51:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:36.208 00:51:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:36.208 00:51:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:36.208 00:51:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:36.208 00:51:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:36.208 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.208 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:36.208 00:51:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:36.208 00:51:43 -- nvmf/common.sh@105 -- # continue 2 00:17:36.208 00:51:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:36.208 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.208 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:36.208 00:51:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:36.208 00:51:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:36.208 00:51:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:36.208 00:51:43 -- nvmf/common.sh@105 -- # continue 2 00:17:36.208 00:51:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:36.208 00:51:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:36.208 00:51:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:36.208 00:51:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:36.208 00:51:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:36.208 00:51:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:36.208 00:51:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:36.208 00:51:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:36.208 192.168.100.9' 00:17:36.208 00:51:43 -- nvmf/common.sh@446 -- # head -n 1 00:17:36.208 00:51:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:36.208 192.168.100.9' 00:17:36.208 00:51:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:36.208 00:51:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:36.208 192.168.100.9' 00:17:36.208 00:51:43 -- nvmf/common.sh@447 -- # tail -n +2 00:17:36.208 00:51:43 -- nvmf/common.sh@447 -- # head -n 1 00:17:36.467 00:51:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:36.467 00:51:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:36.467 00:51:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:36.467 00:51:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:36.467 00:51:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:36.467 00:51:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:36.467 00:51:43 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:36.467 00:51:43 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:36.467 00:51:43 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:36.467 00:51:43 -- common/autotest_common.sh@10 -- # set +x 00:17:36.467 00:51:43 -- nvmf/common.sh@470 -- # nvmfpid=302833 00:17:36.467 00:51:43 -- nvmf/common.sh@471 -- # waitforlisten 302833 00:17:36.467 00:51:43 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:36.467 00:51:43 -- common/autotest_common.sh@817 -- # '[' -z 302833 ']' 00:17:36.467 00:51:43 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:36.467 00:51:43 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:36.467 00:51:43 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:36.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:36.467 00:51:43 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:36.467 00:51:43 -- common/autotest_common.sh@10 -- # set +x 00:17:36.467 [2024-04-26 00:51:43.479432] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:36.467 [2024-04-26 00:51:43.479473] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:36.467 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.467 [2024-04-26 00:51:43.528768] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:36.467 [2024-04-26 00:51:43.599787] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:36.467 [2024-04-26 00:51:43.599821] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:36.467 [2024-04-26 00:51:43.599828] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:36.467 [2024-04-26 00:51:43.599833] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:36.467 [2024-04-26 00:51:43.599838] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:36.467 [2024-04-26 00:51:43.599879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:36.467 [2024-04-26 00:51:43.599972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:36.467 [2024-04-26 00:51:43.599962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:37.405 00:51:44 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:37.405 00:51:44 -- common/autotest_common.sh@850 -- # return 0 00:17:37.405 00:51:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:37.405 00:51:44 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:37.405 00:51:44 -- common/autotest_common.sh@10 -- # set +x 00:17:37.405 00:51:44 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:37.405 00:51:44 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:37.405 [2024-04-26 00:51:44.469084] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x837d80/0x83c270) succeed. 00:17:37.405 [2024-04-26 00:51:44.478141] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x839320/0x87d900) succeed. 00:17:37.405 00:51:44 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:37.665 00:51:44 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:37.665 00:51:44 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:37.925 00:51:44 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:37.925 00:51:44 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:37.925 00:51:45 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:38.185 00:51:45 -- target/nvmf_lvol.sh@29 -- # lvs=c1cb693a-19b3-4931-9b87-f35259e329d4 00:17:38.185 00:51:45 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c1cb693a-19b3-4931-9b87-f35259e329d4 lvol 20 00:17:38.444 00:51:45 -- target/nvmf_lvol.sh@32 -- # lvol=3aa5b4d5-62cf-475b-b1cd-6fe4e5fb322a 00:17:38.444 00:51:45 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:38.444 00:51:45 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 3aa5b4d5-62cf-475b-b1cd-6fe4e5fb322a 00:17:38.704 00:51:45 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:38.704 [2024-04-26 00:51:45.879969] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:38.704 00:51:45 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:38.963 00:51:46 -- target/nvmf_lvol.sh@42 -- # perf_pid=303388 00:17:38.963 00:51:46 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:38.963 00:51:46 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:38.963 EAL: No free 2048 kB hugepages reported on node 1 00:17:39.902 00:51:47 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 3aa5b4d5-62cf-475b-b1cd-6fe4e5fb322a MY_SNAPSHOT 00:17:40.162 00:51:47 -- target/nvmf_lvol.sh@47 -- # snapshot=f6451984-91dd-42e5-800a-c1a2766972de 00:17:40.162 00:51:47 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 3aa5b4d5-62cf-475b-b1cd-6fe4e5fb322a 30 00:17:40.422 00:51:47 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone f6451984-91dd-42e5-800a-c1a2766972de MY_CLONE 00:17:40.422 00:51:47 -- target/nvmf_lvol.sh@49 -- # clone=f77ab148-8078-454e-93d6-4341a764385e 00:17:40.422 00:51:47 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate f77ab148-8078-454e-93d6-4341a764385e 00:17:40.682 00:51:47 -- target/nvmf_lvol.sh@53 -- # wait 303388 00:17:50.666 Initializing NVMe Controllers 00:17:50.666 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:17:50.666 Controller IO queue size 128, less than required. 00:17:50.666 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:50.666 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:50.666 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:50.666 Initialization complete. Launching workers. 00:17:50.666 ======================================================== 00:17:50.666 Latency(us) 00:17:50.666 Device Information : IOPS MiB/s Average min max 00:17:50.666 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 17989.60 70.27 7116.97 2093.99 33810.27 00:17:50.666 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 17951.80 70.12 7131.76 3536.48 43405.04 00:17:50.666 ======================================================== 00:17:50.666 Total : 35941.40 140.40 7124.36 2093.99 43405.04 00:17:50.666 00:17:50.666 00:51:57 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:50.666 00:51:57 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3aa5b4d5-62cf-475b-b1cd-6fe4e5fb322a 00:17:50.666 00:51:57 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c1cb693a-19b3-4931-9b87-f35259e329d4 00:17:50.925 00:51:57 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:50.925 00:51:57 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:50.925 00:51:57 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:50.925 00:51:57 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:50.925 00:51:57 -- nvmf/common.sh@117 -- # sync 00:17:50.925 00:51:57 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:50.925 00:51:57 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:50.925 00:51:57 -- nvmf/common.sh@120 -- # set +e 00:17:50.925 00:51:57 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:50.925 00:51:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:50.925 rmmod nvme_rdma 00:17:50.925 rmmod nvme_fabrics 00:17:50.925 00:51:57 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:50.925 00:51:57 -- nvmf/common.sh@124 -- # set -e 00:17:50.925 00:51:57 -- nvmf/common.sh@125 -- # return 0 00:17:50.925 00:51:57 -- nvmf/common.sh@478 -- # '[' -n 302833 ']' 00:17:50.925 00:51:57 -- nvmf/common.sh@479 -- # killprocess 302833 00:17:50.925 00:51:57 -- common/autotest_common.sh@936 -- # '[' -z 302833 ']' 00:17:50.925 00:51:57 -- common/autotest_common.sh@940 -- # kill -0 302833 00:17:50.925 00:51:57 -- common/autotest_common.sh@941 -- # uname 00:17:50.925 00:51:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:50.925 00:51:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 302833 00:17:50.925 00:51:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:50.925 00:51:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:50.925 00:51:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 302833' 00:17:50.925 killing process with pid 302833 00:17:50.925 00:51:58 -- common/autotest_common.sh@955 -- # kill 302833 00:17:50.925 00:51:58 -- common/autotest_common.sh@960 -- # wait 302833 00:17:50.925 [2024-04-26 00:51:58.082746] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:51.186 00:51:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:51.186 00:51:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:51.186 00:17:51.186 real 0m20.356s 00:17:51.186 user 1m9.843s 00:17:51.186 sys 0m5.071s 00:17:51.186 00:51:58 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:17:51.186 00:51:58 -- common/autotest_common.sh@10 -- # set +x 00:17:51.186 ************************************ 00:17:51.186 END TEST nvmf_lvol 00:17:51.186 ************************************ 00:17:51.186 00:51:58 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:51.186 00:51:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:51.186 00:51:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:51.186 00:51:58 -- common/autotest_common.sh@10 -- # set +x 00:17:51.447 ************************************ 00:17:51.447 START TEST nvmf_lvs_grow 00:17:51.447 ************************************ 00:17:51.447 00:51:58 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:17:51.447 * Looking for test storage... 00:17:51.447 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:51.447 00:51:58 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:51.447 00:51:58 -- nvmf/common.sh@7 -- # uname -s 00:17:51.447 00:51:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:51.447 00:51:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:51.447 00:51:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:51.447 00:51:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:51.447 00:51:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:51.447 00:51:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:51.447 00:51:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:51.447 00:51:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:51.447 00:51:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:51.447 00:51:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:51.447 00:51:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:17:51.447 00:51:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:17:51.447 00:51:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:51.447 00:51:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:51.447 00:51:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:51.447 00:51:58 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:51.447 00:51:58 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:51.447 00:51:58 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:51.447 00:51:58 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:51.447 00:51:58 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:51.447 00:51:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.447 00:51:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.447 00:51:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.447 00:51:58 -- paths/export.sh@5 -- # export PATH 00:17:51.447 00:51:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:51.447 00:51:58 -- nvmf/common.sh@47 -- # : 0 00:17:51.447 00:51:58 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:51.447 00:51:58 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:51.447 00:51:58 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:51.447 00:51:58 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:51.447 00:51:58 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:51.447 00:51:58 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:51.447 00:51:58 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:51.447 00:51:58 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:51.447 00:51:58 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:17:51.447 00:51:58 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.447 00:51:58 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:51.447 00:51:58 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:51.447 00:51:58 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:51.447 00:51:58 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:51.447 00:51:58 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:51.447 00:51:58 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:51.447 00:51:58 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:51.447 00:51:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:51.447 00:51:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:51.447 00:51:58 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:51.447 00:51:58 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:51.447 00:51:58 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:51.447 00:51:58 -- common/autotest_common.sh@10 -- # set +x 00:17:56.730 00:52:03 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:56.730 00:52:03 -- nvmf/common.sh@291 -- # pci_devs=() 00:17:56.730 00:52:03 -- nvmf/common.sh@291 -- # local -a pci_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:17:56.730 00:52:03 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@293 -- # pci_drivers=() 00:17:56.730 00:52:03 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:17:56.730 00:52:03 -- nvmf/common.sh@295 -- # net_devs=() 00:17:56.730 00:52:03 -- nvmf/common.sh@295 -- # local -ga net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@296 -- # e810=() 00:17:56.730 00:52:03 -- nvmf/common.sh@296 -- # local -ga e810 00:17:56.730 00:52:03 -- nvmf/common.sh@297 -- # x722=() 00:17:56.730 00:52:03 -- nvmf/common.sh@297 -- # local -ga x722 00:17:56.730 00:52:03 -- nvmf/common.sh@298 -- # mlx=() 00:17:56.730 00:52:03 -- nvmf/common.sh@298 -- # local -ga mlx 00:17:56.730 00:52:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:56.730 00:52:03 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:17:56.730 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:17:56.730 00:52:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:56.730 00:52:03 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:17:56.730 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:17:56.730 00:52:03 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:17:56.730 00:52:03 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.730 00:52:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.730 00:52:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:17:56.730 Found net devices under 0000:18:00.0: mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.730 00:52:03 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.730 00:52:03 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:17:56.730 Found net devices under 0000:18:00.1: mlx_0_1 00:17:56.730 00:52:03 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.730 00:52:03 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@403 -- # is_hw=yes 00:17:56.730 00:52:03 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@409 -- # rdma_device_init 00:17:56.730 00:52:03 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:17:56.730 00:52:03 -- nvmf/common.sh@58 -- # uname 00:17:56.730 00:52:03 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:17:56.730 00:52:03 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:17:56.730 00:52:03 -- nvmf/common.sh@63 -- # modprobe ib_core 00:17:56.730 00:52:03 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:17:56.730 00:52:03 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:17:56.730 00:52:03 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:17:56.730 00:52:03 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:17:56.730 00:52:03 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:17:56.730 00:52:03 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:17:56.730 00:52:03 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:17:56.730 00:52:03 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:17:56.730 00:52:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:56.730 00:52:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:56.730 00:52:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@105 -- # continue 2 00:17:56.730 00:52:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:56.730 00:52:03 -- nvmf/common.sh@105 -- # continue 2 00:17:56.730 00:52:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:56.730 00:52:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:56.730 00:52:03 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:17:56.730 00:52:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:17:56.730 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:56.730 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:17:56.730 altname enp24s0f0np0 00:17:56.730 altname ens785f0np0 00:17:56.730 inet 192.168.100.8/24 scope global mlx_0_0 00:17:56.730 valid_lft forever preferred_lft forever 00:17:56.730 00:52:03 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:17:56.730 00:52:03 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:17:56.730 00:52:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:56.730 00:52:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:56.730 00:52:03 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:17:56.730 00:52:03 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:17:56.730 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:17:56.730 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:17:56.730 altname enp24s0f1np1 00:17:56.730 altname ens785f1np1 00:17:56.730 inet 192.168.100.9/24 scope global mlx_0_1 00:17:56.730 valid_lft forever preferred_lft forever 00:17:56.730 00:52:03 -- nvmf/common.sh@411 -- # return 0 00:17:56.730 00:52:03 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:17:56.730 00:52:03 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:17:56.730 00:52:03 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:17:56.730 00:52:03 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:17:56.730 00:52:03 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:17:56.730 00:52:03 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:17:56.730 00:52:03 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:17:56.730 00:52:03 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:17:56.730 00:52:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.730 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:17:56.730 00:52:03 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:17:56.730 00:52:03 -- nvmf/common.sh@105 -- # continue 2 00:17:56.731 00:52:03 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:17:56.731 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.731 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:17:56.731 00:52:03 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:17:56.731 00:52:03 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:17:56.731 00:52:03 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:17:56.731 00:52:03 -- nvmf/common.sh@105 -- # continue 2 00:17:56.731 00:52:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:56.731 00:52:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:17:56.731 00:52:03 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:56.731 00:52:03 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:17:56.731 00:52:03 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:17:56.731 00:52:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:17:56.731 00:52:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:17:56.731 00:52:03 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:17:56.731 192.168.100.9' 00:17:56.731 00:52:03 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:17:56.731 192.168.100.9' 00:17:56.731 00:52:03 -- nvmf/common.sh@446 -- # head -n 1 00:17:56.731 00:52:03 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:17:56.731 00:52:03 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:17:56.731 192.168.100.9' 00:17:56.731 00:52:03 -- nvmf/common.sh@447 -- # tail -n +2 00:17:56.731 00:52:03 -- nvmf/common.sh@447 -- # head -n 1 00:17:56.731 00:52:03 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:17:56.731 00:52:03 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:17:56.731 00:52:03 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:17:56.731 00:52:03 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:17:56.731 00:52:03 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:17:56.731 00:52:03 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:17:56.731 00:52:03 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:56.731 00:52:03 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:17:56.731 00:52:03 -- common/autotest_common.sh@710 -- # xtrace_disable 00:17:56.731 00:52:03 -- common/autotest_common.sh@10 -- # set +x 00:17:56.731 00:52:03 -- nvmf/common.sh@470 -- # nvmfpid=308740 00:17:56.731 00:52:03 -- nvmf/common.sh@471 -- # waitforlisten 308740 00:17:56.731 00:52:03 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:56.731 00:52:03 -- common/autotest_common.sh@817 -- # '[' -z 308740 ']' 00:17:56.731 00:52:03 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.731 00:52:03 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:56.731 00:52:03 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.731 00:52:03 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:56.731 00:52:03 -- common/autotest_common.sh@10 -- # set +x 00:17:56.731 [2024-04-26 00:52:03.705588] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:56.731 [2024-04-26 00:52:03.705628] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.731 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.731 [2024-04-26 00:52:03.755581] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:56.731 [2024-04-26 00:52:03.822805] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:56.731 [2024-04-26 00:52:03.822842] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:56.731 [2024-04-26 00:52:03.822848] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:56.731 [2024-04-26 00:52:03.822853] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:56.731 [2024-04-26 00:52:03.822858] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:56.731 [2024-04-26 00:52:03.822874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:57.300 00:52:04 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:17:57.300 00:52:04 -- common/autotest_common.sh@850 -- # return 0 00:17:57.300 00:52:04 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:17:57.300 00:52:04 -- common/autotest_common.sh@716 -- # xtrace_disable 00:17:57.300 00:52:04 -- common/autotest_common.sh@10 -- # set +x 00:17:57.560 00:52:04 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:57.560 00:52:04 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:17:57.560 [2024-04-26 00:52:04.653708] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1088700/0x108cbf0) succeed. 00:17:57.560 [2024-04-26 00:52:04.661707] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1089c00/0x10ce280) succeed. 00:17:57.560 00:52:04 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:57.560 00:52:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:57.560 00:52:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:57.560 00:52:04 -- common/autotest_common.sh@10 -- # set +x 00:17:57.818 ************************************ 00:17:57.818 START TEST lvs_grow_clean 00:17:57.818 ************************************ 00:17:57.818 00:52:04 -- common/autotest_common.sh@1111 -- # lvs_grow 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:57.818 00:52:04 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:58.077 00:52:05 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:58.077 00:52:05 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:58.077 00:52:05 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f97b3623-793f-4320-8a77-7309ddaaa33a 00:17:58.077 00:52:05 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:17:58.077 00:52:05 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:58.336 00:52:05 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:58.336 00:52:05 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:58.336 00:52:05 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f97b3623-793f-4320-8a77-7309ddaaa33a lvol 150 00:17:58.336 00:52:05 -- target/nvmf_lvs_grow.sh@33 -- # lvol=1b4dc364-542a-4aae-bd74-31e503c81ef2 00:17:58.337 00:52:05 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:58.337 00:52:05 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:58.596 [2024-04-26 00:52:05.667245] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:58.596 [2024-04-26 00:52:05.667294] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:58.596 true 00:17:58.596 00:52:05 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:17:58.596 00:52:05 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:58.854 00:52:05 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:58.854 00:52:05 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:58.854 00:52:06 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 1b4dc364-542a-4aae-bd74-31e503c81ef2 00:17:59.112 00:52:06 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:17:59.112 [2024-04-26 00:52:06.281264] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:17:59.112 00:52:06 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:17:59.371 00:52:06 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=309270 00:17:59.371 00:52:06 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:59.371 00:52:06 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:59.371 00:52:06 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 309270 /var/tmp/bdevperf.sock 00:17:59.371 00:52:06 -- common/autotest_common.sh@817 -- # '[' -z 309270 ']' 00:17:59.371 00:52:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.371 00:52:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:17:59.371 00:52:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.371 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.371 00:52:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:17:59.371 00:52:06 -- common/autotest_common.sh@10 -- # set +x 00:17:59.371 [2024-04-26 00:52:06.475155] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:17:59.371 [2024-04-26 00:52:06.475196] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid309270 ] 00:17:59.371 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.371 [2024-04-26 00:52:06.523303] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.630 [2024-04-26 00:52:06.595405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:00.198 00:52:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:00.198 00:52:07 -- common/autotest_common.sh@850 -- # return 0 00:18:00.198 00:52:07 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:00.458 Nvme0n1 00:18:00.458 00:52:07 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:00.458 [ 00:18:00.458 { 00:18:00.458 "name": "Nvme0n1", 00:18:00.458 "aliases": [ 00:18:00.458 "1b4dc364-542a-4aae-bd74-31e503c81ef2" 00:18:00.458 ], 00:18:00.458 "product_name": "NVMe disk", 00:18:00.458 "block_size": 4096, 00:18:00.458 "num_blocks": 38912, 00:18:00.458 "uuid": "1b4dc364-542a-4aae-bd74-31e503c81ef2", 00:18:00.458 "assigned_rate_limits": { 00:18:00.458 "rw_ios_per_sec": 0, 00:18:00.458 "rw_mbytes_per_sec": 0, 00:18:00.458 "r_mbytes_per_sec": 0, 00:18:00.458 "w_mbytes_per_sec": 0 00:18:00.458 }, 00:18:00.458 "claimed": false, 00:18:00.458 "zoned": false, 00:18:00.458 "supported_io_types": { 00:18:00.458 "read": true, 00:18:00.458 "write": true, 00:18:00.458 "unmap": true, 00:18:00.458 "write_zeroes": true, 00:18:00.458 "flush": true, 00:18:00.458 "reset": true, 00:18:00.458 "compare": true, 00:18:00.458 "compare_and_write": true, 00:18:00.458 "abort": true, 00:18:00.458 "nvme_admin": true, 00:18:00.458 "nvme_io": true 00:18:00.458 }, 00:18:00.458 "memory_domains": [ 00:18:00.458 { 00:18:00.458 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:18:00.458 "dma_device_type": 0 00:18:00.458 } 00:18:00.458 ], 00:18:00.458 "driver_specific": { 00:18:00.458 "nvme": [ 00:18:00.458 { 00:18:00.458 "trid": { 00:18:00.458 "trtype": "RDMA", 00:18:00.458 "adrfam": "IPv4", 00:18:00.458 "traddr": "192.168.100.8", 00:18:00.458 "trsvcid": "4420", 00:18:00.458 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:00.458 }, 00:18:00.458 "ctrlr_data": { 00:18:00.458 "cntlid": 1, 00:18:00.458 "vendor_id": "0x8086", 00:18:00.458 "model_number": "SPDK bdev Controller", 00:18:00.458 "serial_number": "SPDK0", 00:18:00.458 "firmware_revision": "24.05", 00:18:00.458 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:00.458 "oacs": { 00:18:00.458 "security": 0, 00:18:00.458 "format": 0, 00:18:00.458 "firmware": 0, 00:18:00.458 "ns_manage": 0 00:18:00.458 }, 00:18:00.458 "multi_ctrlr": true, 00:18:00.458 "ana_reporting": false 00:18:00.458 }, 00:18:00.458 "vs": { 00:18:00.458 "nvme_version": "1.3" 00:18:00.458 }, 00:18:00.458 "ns_data": { 00:18:00.458 "id": 1, 00:18:00.458 "can_share": true 00:18:00.458 } 00:18:00.458 } 00:18:00.458 ], 00:18:00.458 "mp_policy": "active_passive" 00:18:00.458 } 00:18:00.458 } 00:18:00.458 ] 00:18:00.458 00:52:07 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=309385 00:18:00.458 00:52:07 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:00.458 00:52:07 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:00.717 Running I/O for 10 seconds... 00:18:01.680 Latency(us) 00:18:01.680 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.680 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.680 Nvme0n1 : 1.00 38432.00 150.12 0.00 0.00 0.00 0.00 0.00 00:18:01.680 =================================================================================================================== 00:18:01.680 Total : 38432.00 150.12 0.00 0.00 0.00 0.00 0.00 00:18:01.680 00:18:02.618 00:52:09 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:02.618 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.618 Nvme0n1 : 2.00 38750.50 151.37 0.00 0.00 0.00 0.00 0.00 00:18:02.618 =================================================================================================================== 00:18:02.618 Total : 38750.50 151.37 0.00 0.00 0.00 0.00 0.00 00:18:02.618 00:18:02.618 true 00:18:02.618 00:52:09 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:02.618 00:52:09 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:02.876 00:52:09 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:02.876 00:52:09 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:02.876 00:52:09 -- target/nvmf_lvs_grow.sh@65 -- # wait 309385 00:18:03.813 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.813 Nvme0n1 : 3.00 38766.00 151.43 0.00 0.00 0.00 0.00 0.00 00:18:03.813 =================================================================================================================== 00:18:03.813 Total : 38766.00 151.43 0.00 0.00 0.00 0.00 0.00 00:18:03.813 00:18:04.750 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.750 Nvme0n1 : 4.00 38934.75 152.09 0.00 0.00 0.00 0.00 0.00 00:18:04.750 =================================================================================================================== 00:18:04.750 Total : 38934.75 152.09 0.00 0.00 0.00 0.00 0.00 00:18:04.750 00:18:05.686 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.686 Nvme0n1 : 5.00 39013.20 152.40 0.00 0.00 0.00 0.00 0.00 00:18:05.686 =================================================================================================================== 00:18:05.686 Total : 39013.20 152.40 0.00 0.00 0.00 0.00 0.00 00:18:05.686 00:18:06.625 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.625 Nvme0n1 : 6.00 39081.67 152.66 0.00 0.00 0.00 0.00 0.00 00:18:06.625 =================================================================================================================== 00:18:06.625 Total : 39081.67 152.66 0.00 0.00 0.00 0.00 0.00 00:18:06.625 00:18:07.562 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:07.562 Nvme0n1 : 7.00 39142.00 152.90 0.00 0.00 0.00 0.00 0.00 00:18:07.562 =================================================================================================================== 00:18:07.562 Total : 39142.00 152.90 0.00 0.00 0.00 0.00 0.00 00:18:07.562 00:18:08.940 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:08.940 Nvme0n1 : 8.00 39179.25 153.04 0.00 0.00 0.00 0.00 0.00 00:18:08.940 =================================================================================================================== 00:18:08.940 Total : 39179.25 153.04 0.00 0.00 0.00 0.00 0.00 00:18:08.940 00:18:09.878 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:09.878 Nvme0n1 : 9.00 39211.67 153.17 0.00 0.00 0.00 0.00 0.00 00:18:09.878 =================================================================================================================== 00:18:09.878 Total : 39211.67 153.17 0.00 0.00 0.00 0.00 0.00 00:18:09.878 00:18:10.817 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.817 Nvme0n1 : 10.00 39239.30 153.28 0.00 0.00 0.00 0.00 0.00 00:18:10.817 =================================================================================================================== 00:18:10.817 Total : 39239.30 153.28 0.00 0.00 0.00 0.00 0.00 00:18:10.817 00:18:10.817 00:18:10.817 Latency(us) 00:18:10.817 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.817 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:10.817 Nvme0n1 : 10.00 39239.40 153.28 0.00 0.00 3259.51 2475.80 15922.82 00:18:10.817 =================================================================================================================== 00:18:10.817 Total : 39239.40 153.28 0.00 0.00 3259.51 2475.80 15922.82 00:18:10.817 0 00:18:10.817 00:52:17 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 309270 00:18:10.817 00:52:17 -- common/autotest_common.sh@936 -- # '[' -z 309270 ']' 00:18:10.817 00:52:17 -- common/autotest_common.sh@940 -- # kill -0 309270 00:18:10.817 00:52:17 -- common/autotest_common.sh@941 -- # uname 00:18:10.817 00:52:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.817 00:52:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 309270 00:18:10.817 00:52:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:10.817 00:52:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:10.817 00:52:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 309270' 00:18:10.817 killing process with pid 309270 00:18:10.817 00:52:17 -- common/autotest_common.sh@955 -- # kill 309270 00:18:10.817 Received shutdown signal, test time was about 10.000000 seconds 00:18:10.817 00:18:10.817 Latency(us) 00:18:10.817 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.817 =================================================================================================================== 00:18:10.817 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:10.817 00:52:17 -- common/autotest_common.sh@960 -- # wait 309270 00:18:11.076 00:52:18 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:11.076 00:52:18 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:11.076 00:52:18 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:11.336 00:52:18 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:11.336 00:52:18 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:18:11.336 00:52:18 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:11.336 [2024-04-26 00:52:18.488440] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:11.596 00:52:18 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:11.596 00:52:18 -- common/autotest_common.sh@638 -- # local es=0 00:18:11.596 00:52:18 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:11.596 00:52:18 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.596 00:52:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.596 00:52:18 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.596 00:52:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.596 00:52:18 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.596 00:52:18 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:11.596 00:52:18 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:11.596 00:52:18 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:18:11.596 00:52:18 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:11.596 request: 00:18:11.596 { 00:18:11.596 "uuid": "f97b3623-793f-4320-8a77-7309ddaaa33a", 00:18:11.596 "method": "bdev_lvol_get_lvstores", 00:18:11.596 "req_id": 1 00:18:11.596 } 00:18:11.596 Got JSON-RPC error response 00:18:11.596 response: 00:18:11.596 { 00:18:11.596 "code": -19, 00:18:11.596 "message": "No such device" 00:18:11.596 } 00:18:11.596 00:52:18 -- common/autotest_common.sh@641 -- # es=1 00:18:11.596 00:52:18 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:18:11.596 00:52:18 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:18:11.596 00:52:18 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:18:11.596 00:52:18 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:11.856 aio_bdev 00:18:11.856 00:52:18 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 1b4dc364-542a-4aae-bd74-31e503c81ef2 00:18:11.856 00:52:18 -- common/autotest_common.sh@885 -- # local bdev_name=1b4dc364-542a-4aae-bd74-31e503c81ef2 00:18:11.856 00:52:18 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:11.856 00:52:18 -- common/autotest_common.sh@887 -- # local i 00:18:11.856 00:52:18 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:11.856 00:52:18 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:11.856 00:52:18 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:11.856 00:52:19 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 1b4dc364-542a-4aae-bd74-31e503c81ef2 -t 2000 00:18:12.231 [ 00:18:12.231 { 00:18:12.231 "name": "1b4dc364-542a-4aae-bd74-31e503c81ef2", 00:18:12.231 "aliases": [ 00:18:12.231 "lvs/lvol" 00:18:12.231 ], 00:18:12.231 "product_name": "Logical Volume", 00:18:12.231 "block_size": 4096, 00:18:12.231 "num_blocks": 38912, 00:18:12.231 "uuid": "1b4dc364-542a-4aae-bd74-31e503c81ef2", 00:18:12.231 "assigned_rate_limits": { 00:18:12.231 "rw_ios_per_sec": 0, 00:18:12.231 "rw_mbytes_per_sec": 0, 00:18:12.231 "r_mbytes_per_sec": 0, 00:18:12.231 "w_mbytes_per_sec": 0 00:18:12.231 }, 00:18:12.231 "claimed": false, 00:18:12.231 "zoned": false, 00:18:12.231 "supported_io_types": { 00:18:12.231 "read": true, 00:18:12.231 "write": true, 00:18:12.231 "unmap": true, 00:18:12.231 "write_zeroes": true, 00:18:12.231 "flush": false, 00:18:12.231 "reset": true, 00:18:12.231 "compare": false, 00:18:12.231 "compare_and_write": false, 00:18:12.231 "abort": false, 00:18:12.231 "nvme_admin": false, 00:18:12.231 "nvme_io": false 00:18:12.231 }, 00:18:12.231 "driver_specific": { 00:18:12.231 "lvol": { 00:18:12.231 "lvol_store_uuid": "f97b3623-793f-4320-8a77-7309ddaaa33a", 00:18:12.231 "base_bdev": "aio_bdev", 00:18:12.231 "thin_provision": false, 00:18:12.231 "snapshot": false, 00:18:12.231 "clone": false, 00:18:12.232 "esnap_clone": false 00:18:12.232 } 00:18:12.232 } 00:18:12.232 } 00:18:12.232 ] 00:18:12.232 00:52:19 -- common/autotest_common.sh@893 -- # return 0 00:18:12.232 00:52:19 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:12.232 00:52:19 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:12.232 00:52:19 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:12.232 00:52:19 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:12.232 00:52:19 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:12.518 00:52:19 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:12.518 00:52:19 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1b4dc364-542a-4aae-bd74-31e503c81ef2 00:18:12.518 00:52:19 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f97b3623-793f-4320-8a77-7309ddaaa33a 00:18:12.802 00:52:19 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:12.803 00:52:19 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:12.803 00:18:12.803 real 0m15.110s 00:18:12.803 user 0m15.179s 00:18:12.803 sys 0m0.926s 00:18:12.803 00:52:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:12.803 00:52:19 -- common/autotest_common.sh@10 -- # set +x 00:18:12.803 ************************************ 00:18:12.803 END TEST lvs_grow_clean 00:18:12.803 ************************************ 00:18:12.803 00:52:19 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:18:12.803 00:52:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:12.803 00:52:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:12.803 00:52:19 -- common/autotest_common.sh@10 -- # set +x 00:18:13.067 ************************************ 00:18:13.067 START TEST lvs_grow_dirty 00:18:13.067 ************************************ 00:18:13.067 00:52:20 -- common/autotest_common.sh@1111 -- # lvs_grow dirty 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:13.067 00:52:20 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:13.331 00:52:20 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:18:13.331 00:52:20 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:18:13.331 00:52:20 -- target/nvmf_lvs_grow.sh@28 -- # lvs=46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:13.331 00:52:20 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:13.331 00:52:20 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 lvol 150 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:13.598 00:52:20 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:18:13.866 [2024-04-26 00:52:20.894698] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:18:13.866 [2024-04-26 00:52:20.894748] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:18:13.866 true 00:18:13.866 00:52:20 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:18:13.866 00:52:20 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:14.137 00:52:21 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:18:14.137 00:52:21 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:18:14.137 00:52:21 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:14.415 00:52:21 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:18:14.415 00:52:21 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:18:14.682 00:52:21 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=312025 00:18:14.682 00:52:21 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:18:14.682 00:52:21 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:14.682 00:52:21 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 312025 /var/tmp/bdevperf.sock 00:18:14.682 00:52:21 -- common/autotest_common.sh@817 -- # '[' -z 312025 ']' 00:18:14.682 00:52:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:14.682 00:52:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:14.682 00:52:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:14.682 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:14.682 00:52:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:14.682 00:52:21 -- common/autotest_common.sh@10 -- # set +x 00:18:14.682 [2024-04-26 00:52:21.707378] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:14.682 [2024-04-26 00:52:21.707425] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid312025 ] 00:18:14.682 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.682 [2024-04-26 00:52:21.755667] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.682 [2024-04-26 00:52:21.826674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.651 00:52:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:15.651 00:52:22 -- common/autotest_common.sh@850 -- # return 0 00:18:15.651 00:52:22 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:18:15.651 Nvme0n1 00:18:15.651 00:52:22 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:18:15.651 [ 00:18:15.651 { 00:18:15.651 "name": "Nvme0n1", 00:18:15.651 "aliases": [ 00:18:15.651 "a732b972-57b3-4d14-9ad9-e3f374f82cb6" 00:18:15.651 ], 00:18:15.651 "product_name": "NVMe disk", 00:18:15.651 "block_size": 4096, 00:18:15.651 "num_blocks": 38912, 00:18:15.651 "uuid": "a732b972-57b3-4d14-9ad9-e3f374f82cb6", 00:18:15.651 "assigned_rate_limits": { 00:18:15.651 "rw_ios_per_sec": 0, 00:18:15.651 "rw_mbytes_per_sec": 0, 00:18:15.651 "r_mbytes_per_sec": 0, 00:18:15.651 "w_mbytes_per_sec": 0 00:18:15.651 }, 00:18:15.651 "claimed": false, 00:18:15.651 "zoned": false, 00:18:15.651 "supported_io_types": { 00:18:15.651 "read": true, 00:18:15.651 "write": true, 00:18:15.651 "unmap": true, 00:18:15.651 "write_zeroes": true, 00:18:15.651 "flush": true, 00:18:15.651 "reset": true, 00:18:15.651 "compare": true, 00:18:15.651 "compare_and_write": true, 00:18:15.651 "abort": true, 00:18:15.651 "nvme_admin": true, 00:18:15.651 "nvme_io": true 00:18:15.651 }, 00:18:15.651 "memory_domains": [ 00:18:15.651 { 00:18:15.651 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:18:15.651 "dma_device_type": 0 00:18:15.651 } 00:18:15.651 ], 00:18:15.651 "driver_specific": { 00:18:15.651 "nvme": [ 00:18:15.651 { 00:18:15.651 "trid": { 00:18:15.651 "trtype": "RDMA", 00:18:15.651 "adrfam": "IPv4", 00:18:15.651 "traddr": "192.168.100.8", 00:18:15.651 "trsvcid": "4420", 00:18:15.651 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:18:15.651 }, 00:18:15.651 "ctrlr_data": { 00:18:15.651 "cntlid": 1, 00:18:15.651 "vendor_id": "0x8086", 00:18:15.651 "model_number": "SPDK bdev Controller", 00:18:15.651 "serial_number": "SPDK0", 00:18:15.651 "firmware_revision": "24.05", 00:18:15.651 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:18:15.651 "oacs": { 00:18:15.651 "security": 0, 00:18:15.651 "format": 0, 00:18:15.651 "firmware": 0, 00:18:15.651 "ns_manage": 0 00:18:15.651 }, 00:18:15.651 "multi_ctrlr": true, 00:18:15.651 "ana_reporting": false 00:18:15.651 }, 00:18:15.651 "vs": { 00:18:15.651 "nvme_version": "1.3" 00:18:15.651 }, 00:18:15.651 "ns_data": { 00:18:15.651 "id": 1, 00:18:15.651 "can_share": true 00:18:15.651 } 00:18:15.651 } 00:18:15.651 ], 00:18:15.651 "mp_policy": "active_passive" 00:18:15.651 } 00:18:15.651 } 00:18:15.651 ] 00:18:15.920 00:52:22 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=312291 00:18:15.920 00:52:22 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:18:15.920 00:52:22 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:15.920 Running I/O for 10 seconds... 00:18:16.913 Latency(us) 00:18:16.913 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.913 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:16.913 Nvme0n1 : 1.00 38237.00 149.36 0.00 0.00 0.00 0.00 0.00 00:18:16.913 =================================================================================================================== 00:18:16.913 Total : 38237.00 149.36 0.00 0.00 0.00 0.00 0.00 00:18:16.913 00:18:17.918 00:52:24 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:17.918 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:17.918 Nvme0n1 : 2.00 38671.50 151.06 0.00 0.00 0.00 0.00 0.00 00:18:17.918 =================================================================================================================== 00:18:17.918 Total : 38671.50 151.06 0.00 0.00 0.00 0.00 0.00 00:18:17.918 00:18:17.918 true 00:18:17.918 00:52:25 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:17.918 00:52:25 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:18:18.207 00:52:25 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:18:18.207 00:52:25 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:18:18.207 00:52:25 -- target/nvmf_lvs_grow.sh@65 -- # wait 312291 00:18:18.819 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:18.819 Nvme0n1 : 3.00 38773.00 151.46 0.00 0.00 0.00 0.00 0.00 00:18:18.819 =================================================================================================================== 00:18:18.819 Total : 38773.00 151.46 0.00 0.00 0.00 0.00 0.00 00:18:18.819 00:18:19.814 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:19.814 Nvme0n1 : 4.00 38903.75 151.97 0.00 0.00 0.00 0.00 0.00 00:18:19.814 =================================================================================================================== 00:18:19.814 Total : 38903.75 151.97 0.00 0.00 0.00 0.00 0.00 00:18:19.814 00:18:20.810 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:20.810 Nvme0n1 : 5.00 38989.60 152.30 0.00 0.00 0.00 0.00 0.00 00:18:20.810 =================================================================================================================== 00:18:20.810 Total : 38989.60 152.30 0.00 0.00 0.00 0.00 0.00 00:18:20.810 00:18:21.787 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:21.787 Nvme0n1 : 6.00 39045.00 152.52 0.00 0.00 0.00 0.00 0.00 00:18:21.787 =================================================================================================================== 00:18:21.787 Total : 39045.00 152.52 0.00 0.00 0.00 0.00 0.00 00:18:21.787 00:18:23.194 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.194 Nvme0n1 : 7.00 39085.57 152.68 0.00 0.00 0.00 0.00 0.00 00:18:23.194 =================================================================================================================== 00:18:23.194 Total : 39085.57 152.68 0.00 0.00 0.00 0.00 0.00 00:18:23.194 00:18:23.764 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:23.764 Nvme0n1 : 8.00 39115.75 152.80 0.00 0.00 0.00 0.00 0.00 00:18:23.764 =================================================================================================================== 00:18:23.764 Total : 39115.75 152.80 0.00 0.00 0.00 0.00 0.00 00:18:23.764 00:18:25.143 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:25.143 Nvme0n1 : 9.00 39157.22 152.96 0.00 0.00 0.00 0.00 0.00 00:18:25.143 =================================================================================================================== 00:18:25.143 Total : 39157.22 152.96 0.00 0.00 0.00 0.00 0.00 00:18:25.143 00:18:26.089 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.089 Nvme0n1 : 10.00 39183.90 153.06 0.00 0.00 0.00 0.00 0.00 00:18:26.089 =================================================================================================================== 00:18:26.089 Total : 39183.90 153.06 0.00 0.00 0.00 0.00 0.00 00:18:26.089 00:18:26.089 00:18:26.089 Latency(us) 00:18:26.089 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.089 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:26.090 Nvme0n1 : 10.00 39182.28 153.06 0.00 0.00 3264.03 2330.17 11796.48 00:18:26.090 =================================================================================================================== 00:18:26.090 Total : 39182.28 153.06 0.00 0.00 3264.03 2330.17 11796.48 00:18:26.090 0 00:18:26.090 00:52:32 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 312025 00:18:26.090 00:52:32 -- common/autotest_common.sh@936 -- # '[' -z 312025 ']' 00:18:26.090 00:52:32 -- common/autotest_common.sh@940 -- # kill -0 312025 00:18:26.090 00:52:32 -- common/autotest_common.sh@941 -- # uname 00:18:26.090 00:52:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:26.090 00:52:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 312025 00:18:26.090 00:52:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:26.090 00:52:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:26.090 00:52:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 312025' 00:18:26.090 killing process with pid 312025 00:18:26.090 00:52:33 -- common/autotest_common.sh@955 -- # kill 312025 00:18:26.090 Received shutdown signal, test time was about 10.000000 seconds 00:18:26.090 00:18:26.090 Latency(us) 00:18:26.090 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:26.090 =================================================================================================================== 00:18:26.090 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:26.090 00:52:33 -- common/autotest_common.sh@960 -- # wait 312025 00:18:26.090 00:52:33 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:26.348 00:52:33 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:26.348 00:52:33 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:26.607 00:52:33 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:26.607 00:52:33 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:26.607 00:52:33 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 308740 00:18:26.607 00:52:33 -- target/nvmf_lvs_grow.sh@74 -- # wait 308740 00:18:26.608 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 308740 Killed "${NVMF_APP[@]}" "$@" 00:18:26.608 00:52:33 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:26.608 00:52:33 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:26.608 00:52:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:26.608 00:52:33 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:26.608 00:52:33 -- common/autotest_common.sh@10 -- # set +x 00:18:26.608 00:52:33 -- nvmf/common.sh@470 -- # nvmfpid=314168 00:18:26.608 00:52:33 -- nvmf/common.sh@471 -- # waitforlisten 314168 00:18:26.608 00:52:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:26.608 00:52:33 -- common/autotest_common.sh@817 -- # '[' -z 314168 ']' 00:18:26.608 00:52:33 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:26.608 00:52:33 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:26.608 00:52:33 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:26.608 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:26.608 00:52:33 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:26.608 00:52:33 -- common/autotest_common.sh@10 -- # set +x 00:18:26.608 [2024-04-26 00:52:33.645419] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:26.608 [2024-04-26 00:52:33.645461] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:26.608 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.608 [2024-04-26 00:52:33.695538] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.608 [2024-04-26 00:52:33.766221] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:26.608 [2024-04-26 00:52:33.766260] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:26.608 [2024-04-26 00:52:33.766266] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:26.608 [2024-04-26 00:52:33.766271] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:26.608 [2024-04-26 00:52:33.766276] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:26.608 [2024-04-26 00:52:33.766290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:27.545 00:52:34 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:27.545 00:52:34 -- common/autotest_common.sh@850 -- # return 0 00:18:27.545 00:52:34 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:27.545 00:52:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:27.545 00:52:34 -- common/autotest_common.sh@10 -- # set +x 00:18:27.545 00:52:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:27.545 00:52:34 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:27.545 [2024-04-26 00:52:34.589493] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:27.545 [2024-04-26 00:52:34.589585] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:27.545 [2024-04-26 00:52:34.589608] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:27.545 00:52:34 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:27.545 00:52:34 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:27.545 00:52:34 -- common/autotest_common.sh@885 -- # local bdev_name=a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:27.545 00:52:34 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:27.545 00:52:34 -- common/autotest_common.sh@887 -- # local i 00:18:27.545 00:52:34 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:27.545 00:52:34 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:27.545 00:52:34 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:27.804 00:52:34 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a732b972-57b3-4d14-9ad9-e3f374f82cb6 -t 2000 00:18:27.804 [ 00:18:27.804 { 00:18:27.804 "name": "a732b972-57b3-4d14-9ad9-e3f374f82cb6", 00:18:27.804 "aliases": [ 00:18:27.804 "lvs/lvol" 00:18:27.804 ], 00:18:27.804 "product_name": "Logical Volume", 00:18:27.804 "block_size": 4096, 00:18:27.804 "num_blocks": 38912, 00:18:27.804 "uuid": "a732b972-57b3-4d14-9ad9-e3f374f82cb6", 00:18:27.804 "assigned_rate_limits": { 00:18:27.804 "rw_ios_per_sec": 0, 00:18:27.804 "rw_mbytes_per_sec": 0, 00:18:27.804 "r_mbytes_per_sec": 0, 00:18:27.804 "w_mbytes_per_sec": 0 00:18:27.804 }, 00:18:27.804 "claimed": false, 00:18:27.804 "zoned": false, 00:18:27.804 "supported_io_types": { 00:18:27.804 "read": true, 00:18:27.804 "write": true, 00:18:27.804 "unmap": true, 00:18:27.804 "write_zeroes": true, 00:18:27.804 "flush": false, 00:18:27.804 "reset": true, 00:18:27.804 "compare": false, 00:18:27.804 "compare_and_write": false, 00:18:27.804 "abort": false, 00:18:27.804 "nvme_admin": false, 00:18:27.804 "nvme_io": false 00:18:27.804 }, 00:18:27.804 "driver_specific": { 00:18:27.804 "lvol": { 00:18:27.804 "lvol_store_uuid": "46c39877-d22f-4a07-8f85-9acbfb9fd804", 00:18:27.804 "base_bdev": "aio_bdev", 00:18:27.804 "thin_provision": false, 00:18:27.804 "snapshot": false, 00:18:27.804 "clone": false, 00:18:27.804 "esnap_clone": false 00:18:27.804 } 00:18:27.804 } 00:18:27.804 } 00:18:27.804 ] 00:18:27.804 00:52:34 -- common/autotest_common.sh@893 -- # return 0 00:18:27.804 00:52:34 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:27.804 00:52:34 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:28.064 00:52:35 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:28.064 00:52:35 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:28.064 00:52:35 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:28.064 00:52:35 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:28.064 00:52:35 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:28.323 [2024-04-26 00:52:35.329710] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:28.323 00:52:35 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:28.323 00:52:35 -- common/autotest_common.sh@638 -- # local es=0 00:18:28.323 00:52:35 -- common/autotest_common.sh@640 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:28.323 00:52:35 -- common/autotest_common.sh@626 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:28.323 00:52:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:28.323 00:52:35 -- common/autotest_common.sh@630 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:28.323 00:52:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:28.323 00:52:35 -- common/autotest_common.sh@632 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:28.323 00:52:35 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:18:28.323 00:52:35 -- common/autotest_common.sh@632 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:28.323 00:52:35 -- common/autotest_common.sh@632 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:18:28.323 00:52:35 -- common/autotest_common.sh@641 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:28.582 request: 00:18:28.582 { 00:18:28.582 "uuid": "46c39877-d22f-4a07-8f85-9acbfb9fd804", 00:18:28.582 "method": "bdev_lvol_get_lvstores", 00:18:28.582 "req_id": 1 00:18:28.582 } 00:18:28.582 Got JSON-RPC error response 00:18:28.582 response: 00:18:28.582 { 00:18:28.582 "code": -19, 00:18:28.582 "message": "No such device" 00:18:28.582 } 00:18:28.582 00:52:35 -- common/autotest_common.sh@641 -- # es=1 00:18:28.582 00:52:35 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:18:28.582 00:52:35 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:18:28.582 00:52:35 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:18:28.582 00:52:35 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:28.582 aio_bdev 00:18:28.582 00:52:35 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:28.582 00:52:35 -- common/autotest_common.sh@885 -- # local bdev_name=a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:28.582 00:52:35 -- common/autotest_common.sh@886 -- # local bdev_timeout= 00:18:28.582 00:52:35 -- common/autotest_common.sh@887 -- # local i 00:18:28.582 00:52:35 -- common/autotest_common.sh@888 -- # [[ -z '' ]] 00:18:28.582 00:52:35 -- common/autotest_common.sh@888 -- # bdev_timeout=2000 00:18:28.582 00:52:35 -- common/autotest_common.sh@890 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:28.841 00:52:35 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a732b972-57b3-4d14-9ad9-e3f374f82cb6 -t 2000 00:18:28.841 [ 00:18:28.841 { 00:18:28.841 "name": "a732b972-57b3-4d14-9ad9-e3f374f82cb6", 00:18:28.841 "aliases": [ 00:18:28.841 "lvs/lvol" 00:18:28.841 ], 00:18:28.841 "product_name": "Logical Volume", 00:18:28.841 "block_size": 4096, 00:18:28.841 "num_blocks": 38912, 00:18:28.841 "uuid": "a732b972-57b3-4d14-9ad9-e3f374f82cb6", 00:18:28.841 "assigned_rate_limits": { 00:18:28.841 "rw_ios_per_sec": 0, 00:18:28.841 "rw_mbytes_per_sec": 0, 00:18:28.841 "r_mbytes_per_sec": 0, 00:18:28.841 "w_mbytes_per_sec": 0 00:18:28.841 }, 00:18:28.841 "claimed": false, 00:18:28.841 "zoned": false, 00:18:28.841 "supported_io_types": { 00:18:28.841 "read": true, 00:18:28.841 "write": true, 00:18:28.841 "unmap": true, 00:18:28.841 "write_zeroes": true, 00:18:28.841 "flush": false, 00:18:28.841 "reset": true, 00:18:28.841 "compare": false, 00:18:28.841 "compare_and_write": false, 00:18:28.841 "abort": false, 00:18:28.841 "nvme_admin": false, 00:18:28.841 "nvme_io": false 00:18:28.841 }, 00:18:28.841 "driver_specific": { 00:18:28.841 "lvol": { 00:18:28.841 "lvol_store_uuid": "46c39877-d22f-4a07-8f85-9acbfb9fd804", 00:18:28.841 "base_bdev": "aio_bdev", 00:18:28.842 "thin_provision": false, 00:18:28.842 "snapshot": false, 00:18:28.842 "clone": false, 00:18:28.842 "esnap_clone": false 00:18:28.842 } 00:18:28.842 } 00:18:28.842 } 00:18:28.842 ] 00:18:28.842 00:52:36 -- common/autotest_common.sh@893 -- # return 0 00:18:28.842 00:52:36 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:28.842 00:52:36 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:29.101 00:52:36 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:29.101 00:52:36 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:29.101 00:52:36 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:29.361 00:52:36 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:29.361 00:52:36 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a732b972-57b3-4d14-9ad9-e3f374f82cb6 00:18:29.361 00:52:36 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 46c39877-d22f-4a07-8f85-9acbfb9fd804 00:18:29.620 00:52:36 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:29.621 00:52:36 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:29.881 00:18:29.881 real 0m16.714s 00:18:29.881 user 0m44.190s 00:18:29.881 sys 0m2.662s 00:18:29.881 00:52:36 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:29.881 00:52:36 -- common/autotest_common.sh@10 -- # set +x 00:18:29.881 ************************************ 00:18:29.881 END TEST lvs_grow_dirty 00:18:29.881 ************************************ 00:18:29.881 00:52:36 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:29.881 00:52:36 -- common/autotest_common.sh@794 -- # type=--id 00:18:29.881 00:52:36 -- common/autotest_common.sh@795 -- # id=0 00:18:29.881 00:52:36 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:18:29.881 00:52:36 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:29.881 00:52:36 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:18:29.881 00:52:36 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:18:29.881 00:52:36 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:18:29.881 00:52:36 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:29.881 nvmf_trace.0 00:18:29.881 00:52:36 -- common/autotest_common.sh@809 -- # return 0 00:18:29.881 00:52:36 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:29.881 00:52:36 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:29.881 00:52:36 -- nvmf/common.sh@117 -- # sync 00:18:29.881 00:52:36 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:29.881 00:52:36 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:29.881 00:52:36 -- nvmf/common.sh@120 -- # set +e 00:18:29.881 00:52:36 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:29.881 00:52:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:29.881 rmmod nvme_rdma 00:18:29.881 rmmod nvme_fabrics 00:18:29.881 00:52:36 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:29.881 00:52:36 -- nvmf/common.sh@124 -- # set -e 00:18:29.881 00:52:36 -- nvmf/common.sh@125 -- # return 0 00:18:29.881 00:52:36 -- nvmf/common.sh@478 -- # '[' -n 314168 ']' 00:18:29.881 00:52:36 -- nvmf/common.sh@479 -- # killprocess 314168 00:18:29.881 00:52:36 -- common/autotest_common.sh@936 -- # '[' -z 314168 ']' 00:18:29.881 00:52:36 -- common/autotest_common.sh@940 -- # kill -0 314168 00:18:29.881 00:52:36 -- common/autotest_common.sh@941 -- # uname 00:18:29.881 00:52:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:29.881 00:52:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 314168 00:18:29.881 00:52:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:29.881 00:52:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:29.881 00:52:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 314168' 00:18:29.881 killing process with pid 314168 00:18:29.881 00:52:36 -- common/autotest_common.sh@955 -- # kill 314168 00:18:29.881 00:52:36 -- common/autotest_common.sh@960 -- # wait 314168 00:18:30.141 00:52:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:30.141 00:52:37 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:30.141 00:18:30.141 real 0m38.679s 00:18:30.141 user 1m4.658s 00:18:30.141 sys 0m7.946s 00:18:30.141 00:52:37 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:30.141 00:52:37 -- common/autotest_common.sh@10 -- # set +x 00:18:30.141 ************************************ 00:18:30.141 END TEST nvmf_lvs_grow 00:18:30.141 ************************************ 00:18:30.141 00:52:37 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:30.141 00:52:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:30.141 00:52:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:30.141 00:52:37 -- common/autotest_common.sh@10 -- # set +x 00:18:30.402 ************************************ 00:18:30.402 START TEST nvmf_bdev_io_wait 00:18:30.402 ************************************ 00:18:30.402 00:52:37 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:18:30.402 * Looking for test storage... 00:18:30.402 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:30.402 00:52:37 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:30.402 00:52:37 -- nvmf/common.sh@7 -- # uname -s 00:18:30.402 00:52:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:30.402 00:52:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:30.402 00:52:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:30.402 00:52:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:30.402 00:52:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:30.402 00:52:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:30.402 00:52:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:30.402 00:52:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:30.402 00:52:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:30.402 00:52:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:30.402 00:52:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:30.402 00:52:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:30.402 00:52:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:30.402 00:52:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:30.402 00:52:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:30.402 00:52:37 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:30.402 00:52:37 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:30.402 00:52:37 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:30.402 00:52:37 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:30.402 00:52:37 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:30.402 00:52:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.402 00:52:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.402 00:52:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.402 00:52:37 -- paths/export.sh@5 -- # export PATH 00:18:30.402 00:52:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:30.402 00:52:37 -- nvmf/common.sh@47 -- # : 0 00:18:30.402 00:52:37 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:30.402 00:52:37 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:30.402 00:52:37 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:30.402 00:52:37 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:30.402 00:52:37 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:30.402 00:52:37 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:30.402 00:52:37 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:30.402 00:52:37 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:30.402 00:52:37 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:30.402 00:52:37 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:30.402 00:52:37 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:30.402 00:52:37 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:30.402 00:52:37 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:30.402 00:52:37 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:30.402 00:52:37 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:30.402 00:52:37 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:30.402 00:52:37 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.402 00:52:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.402 00:52:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.402 00:52:37 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:30.402 00:52:37 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:30.402 00:52:37 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:30.402 00:52:37 -- common/autotest_common.sh@10 -- # set +x 00:18:35.684 00:52:42 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:35.684 00:52:42 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:35.684 00:52:42 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:35.684 00:52:42 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:35.684 00:52:42 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:35.684 00:52:42 -- nvmf/common.sh@295 -- # net_devs=() 00:18:35.684 00:52:42 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@296 -- # e810=() 00:18:35.684 00:52:42 -- nvmf/common.sh@296 -- # local -ga e810 00:18:35.684 00:52:42 -- nvmf/common.sh@297 -- # x722=() 00:18:35.684 00:52:42 -- nvmf/common.sh@297 -- # local -ga x722 00:18:35.684 00:52:42 -- nvmf/common.sh@298 -- # mlx=() 00:18:35.684 00:52:42 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:35.684 00:52:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:35.684 00:52:42 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:35.684 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:35.684 00:52:42 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:35.684 00:52:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:35.684 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:35.684 00:52:42 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:35.684 00:52:42 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.684 00:52:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.684 00:52:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:35.684 Found net devices under 0000:18:00.0: mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.684 00:52:42 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.684 00:52:42 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:35.684 Found net devices under 0000:18:00.1: mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.684 00:52:42 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:35.684 00:52:42 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:35.684 00:52:42 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:35.684 00:52:42 -- nvmf/common.sh@58 -- # uname 00:18:35.684 00:52:42 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:35.684 00:52:42 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:35.684 00:52:42 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:35.684 00:52:42 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:35.684 00:52:42 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:35.684 00:52:42 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:35.684 00:52:42 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:35.684 00:52:42 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:35.684 00:52:42 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:35.684 00:52:42 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:35.684 00:52:42 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:35.684 00:52:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:35.684 00:52:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:35.684 00:52:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@105 -- # continue 2 00:18:35.684 00:52:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@105 -- # continue 2 00:18:35.684 00:52:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:35.684 00:52:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.684 00:52:42 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:35.684 00:52:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:35.684 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:35.684 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:35.684 altname enp24s0f0np0 00:18:35.684 altname ens785f0np0 00:18:35.684 inet 192.168.100.8/24 scope global mlx_0_0 00:18:35.684 valid_lft forever preferred_lft forever 00:18:35.684 00:52:42 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:35.684 00:52:42 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.684 00:52:42 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:35.684 00:52:42 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:35.684 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:35.684 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:35.684 altname enp24s0f1np1 00:18:35.684 altname ens785f1np1 00:18:35.684 inet 192.168.100.9/24 scope global mlx_0_1 00:18:35.684 valid_lft forever preferred_lft forever 00:18:35.684 00:52:42 -- nvmf/common.sh@411 -- # return 0 00:18:35.684 00:52:42 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:35.684 00:52:42 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:35.684 00:52:42 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:35.684 00:52:42 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:35.684 00:52:42 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:35.684 00:52:42 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:35.684 00:52:42 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:35.684 00:52:42 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:35.684 00:52:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@105 -- # continue 2 00:18:35.684 00:52:42 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.684 00:52:42 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:35.684 00:52:42 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@105 -- # continue 2 00:18:35.684 00:52:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:35.684 00:52:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.684 00:52:42 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:35.684 00:52:42 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.684 00:52:42 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.684 00:52:42 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:35.684 192.168.100.9' 00:18:35.684 00:52:42 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:35.684 192.168.100.9' 00:18:35.684 00:52:42 -- nvmf/common.sh@446 -- # head -n 1 00:18:35.684 00:52:42 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:35.684 00:52:42 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:35.684 192.168.100.9' 00:18:35.684 00:52:42 -- nvmf/common.sh@447 -- # tail -n +2 00:18:35.684 00:52:42 -- nvmf/common.sh@447 -- # head -n 1 00:18:35.684 00:52:42 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:35.684 00:52:42 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:35.684 00:52:42 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:35.684 00:52:42 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:35.684 00:52:42 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:35.684 00:52:42 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:35.943 00:52:42 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:35.943 00:52:42 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:35.943 00:52:42 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:35.943 00:52:42 -- common/autotest_common.sh@10 -- # set +x 00:18:35.943 00:52:42 -- nvmf/common.sh@470 -- # nvmfpid=318168 00:18:35.943 00:52:42 -- nvmf/common.sh@471 -- # waitforlisten 318168 00:18:35.943 00:52:42 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:35.943 00:52:42 -- common/autotest_common.sh@817 -- # '[' -z 318168 ']' 00:18:35.943 00:52:42 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:35.943 00:52:42 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:35.943 00:52:42 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:35.943 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:35.943 00:52:42 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:35.943 00:52:42 -- common/autotest_common.sh@10 -- # set +x 00:18:35.943 [2024-04-26 00:52:42.938338] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:35.943 [2024-04-26 00:52:42.938389] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:35.943 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.943 [2024-04-26 00:52:42.991372] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:35.943 [2024-04-26 00:52:43.062980] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:35.943 [2024-04-26 00:52:43.063021] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:35.943 [2024-04-26 00:52:43.063027] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:35.943 [2024-04-26 00:52:43.063032] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:35.943 [2024-04-26 00:52:43.063036] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:35.943 [2024-04-26 00:52:43.063094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:35.943 [2024-04-26 00:52:43.063187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:35.943 [2024-04-26 00:52:43.063271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:35.943 [2024-04-26 00:52:43.063272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:36.881 00:52:43 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:36.881 00:52:43 -- common/autotest_common.sh@850 -- # return 0 00:18:36.881 00:52:43 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:36.881 00:52:43 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 00:52:43 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:36.881 00:52:43 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:36.881 00:52:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 00:52:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:43 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:36.881 00:52:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 00:52:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:43 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:36.881 00:52:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 [2024-04-26 00:52:43.838596] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x17998e0/0x179ddd0) succeed. 00:18:36.881 [2024-04-26 00:52:43.847601] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x179af20/0x17df460) succeed. 00:18:36.881 00:52:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:43 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:36.881 00:52:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 Malloc0 00:18:36.881 00:52:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:43 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:36.881 00:52:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:43 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 00:52:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:36.881 00:52:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:44 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 00:52:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:36.881 00:52:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:36.881 00:52:44 -- common/autotest_common.sh@10 -- # set +x 00:18:36.881 [2024-04-26 00:52:44.019047] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:36.881 00:52:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=318290 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@30 -- # READ_PID=318292 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:36.881 00:52:44 -- nvmf/common.sh@521 -- # config=() 00:18:36.881 00:52:44 -- nvmf/common.sh@521 -- # local subsystem config 00:18:36.881 00:52:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.881 00:52:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.881 { 00:18:36.881 "params": { 00:18:36.881 "name": "Nvme$subsystem", 00:18:36.881 "trtype": "$TEST_TRANSPORT", 00:18:36.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.881 "adrfam": "ipv4", 00:18:36.881 "trsvcid": "$NVMF_PORT", 00:18:36.881 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.881 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.881 "hdgst": ${hdgst:-false}, 00:18:36.881 "ddgst": ${ddgst:-false} 00:18:36.881 }, 00:18:36.881 "method": "bdev_nvme_attach_controller" 00:18:36.881 } 00:18:36.881 EOF 00:18:36.881 )") 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=318294 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:36.881 00:52:44 -- nvmf/common.sh@521 -- # config=() 00:18:36.881 00:52:44 -- nvmf/common.sh@521 -- # local subsystem config 00:18:36.881 00:52:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:36.881 00:52:44 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=318297 00:18:36.881 00:52:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.881 { 00:18:36.881 "params": { 00:18:36.881 "name": "Nvme$subsystem", 00:18:36.881 "trtype": "$TEST_TRANSPORT", 00:18:36.881 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.881 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "$NVMF_PORT", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.882 "hdgst": ${hdgst:-false}, 00:18:36.882 "ddgst": ${ddgst:-false} 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 } 00:18:36.882 EOF 00:18:36.882 )") 00:18:36.882 00:52:44 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:36.882 00:52:44 -- target/bdev_io_wait.sh@35 -- # sync 00:18:36.882 00:52:44 -- nvmf/common.sh@521 -- # config=() 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # cat 00:18:36.882 00:52:44 -- nvmf/common.sh@521 -- # local subsystem config 00:18:36.882 00:52:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.882 00:52:44 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.882 { 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme$subsystem", 00:18:36.882 "trtype": "$TEST_TRANSPORT", 00:18:36.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "$NVMF_PORT", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.882 "hdgst": ${hdgst:-false}, 00:18:36.882 "ddgst": ${ddgst:-false} 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 } 00:18:36.882 EOF 00:18:36.882 )") 00:18:36.882 00:52:44 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:36.882 00:52:44 -- nvmf/common.sh@521 -- # config=() 00:18:36.882 00:52:44 -- nvmf/common.sh@521 -- # local subsystem config 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # cat 00:18:36.882 00:52:44 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.882 { 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme$subsystem", 00:18:36.882 "trtype": "$TEST_TRANSPORT", 00:18:36.882 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "$NVMF_PORT", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.882 "hdgst": ${hdgst:-false}, 00:18:36.882 "ddgst": ${ddgst:-false} 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 } 00:18:36.882 EOF 00:18:36.882 )") 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # cat 00:18:36.882 00:52:44 -- target/bdev_io_wait.sh@37 -- # wait 318290 00:18:36.882 00:52:44 -- nvmf/common.sh@543 -- # cat 00:18:36.882 00:52:44 -- nvmf/common.sh@545 -- # jq . 00:18:36.882 00:52:44 -- nvmf/common.sh@545 -- # jq . 00:18:36.882 00:52:44 -- nvmf/common.sh@545 -- # jq . 00:18:36.882 00:52:44 -- nvmf/common.sh@546 -- # IFS=, 00:18:36.882 00:52:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme1", 00:18:36.882 "trtype": "rdma", 00:18:36.882 "traddr": "192.168.100.8", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "4420", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.882 "hdgst": false, 00:18:36.882 "ddgst": false 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 }' 00:18:36.882 00:52:44 -- nvmf/common.sh@545 -- # jq . 00:18:36.882 00:52:44 -- nvmf/common.sh@546 -- # IFS=, 00:18:36.882 00:52:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme1", 00:18:36.882 "trtype": "rdma", 00:18:36.882 "traddr": "192.168.100.8", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "4420", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.882 "hdgst": false, 00:18:36.882 "ddgst": false 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 }' 00:18:36.882 00:52:44 -- nvmf/common.sh@546 -- # IFS=, 00:18:36.882 00:52:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme1", 00:18:36.882 "trtype": "rdma", 00:18:36.882 "traddr": "192.168.100.8", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "4420", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.882 "hdgst": false, 00:18:36.882 "ddgst": false 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 }' 00:18:36.882 00:52:44 -- nvmf/common.sh@546 -- # IFS=, 00:18:36.882 00:52:44 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:36.882 "params": { 00:18:36.882 "name": "Nvme1", 00:18:36.882 "trtype": "rdma", 00:18:36.882 "traddr": "192.168.100.8", 00:18:36.882 "adrfam": "ipv4", 00:18:36.882 "trsvcid": "4420", 00:18:36.882 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.882 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.882 "hdgst": false, 00:18:36.882 "ddgst": false 00:18:36.882 }, 00:18:36.882 "method": "bdev_nvme_attach_controller" 00:18:36.882 }' 00:18:36.882 [2024-04-26 00:52:44.067272] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:36.882 [2024-04-26 00:52:44.067313] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:36.882 [2024-04-26 00:52:44.067608] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:36.882 [2024-04-26 00:52:44.067654] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:36.882 [2024-04-26 00:52:44.069361] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:36.882 [2024-04-26 00:52:44.069398] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:37.141 [2024-04-26 00:52:44.080644] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:37.141 [2024-04-26 00:52:44.080710] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:37.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.141 [2024-04-26 00:52:44.251333] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.141 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.141 [2024-04-26 00:52:44.303621] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.141 [2024-04-26 00:52:44.324005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:37.401 EAL: No free 2048 kB hugepages reported on node 1 00:18:37.401 [2024-04-26 00:52:44.368128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:37.401 [2024-04-26 00:52:44.393337] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.401 [2024-04-26 00:52:44.434206] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:37.401 [2024-04-26 00:52:44.477532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:37.401 [2024-04-26 00:52:44.507363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:37.401 Running I/O for 1 seconds... 00:18:37.401 Running I/O for 1 seconds... 00:18:37.660 Running I/O for 1 seconds... 00:18:37.660 Running I/O for 1 seconds... 00:18:38.599 00:18:38.599 Latency(us) 00:18:38.599 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.599 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:38.599 Nvme1n1 : 1.00 18504.62 72.28 0.00 0.00 6897.44 4805.97 17282.09 00:18:38.599 =================================================================================================================== 00:18:38.599 Total : 18504.62 72.28 0.00 0.00 6897.44 4805.97 17282.09 00:18:38.599 00:18:38.599 Latency(us) 00:18:38.599 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.599 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:38.599 Nvme1n1 : 1.01 17521.66 68.44 0.00 0.00 7283.90 5145.79 17476.27 00:18:38.599 =================================================================================================================== 00:18:38.599 Total : 17521.66 68.44 0.00 0.00 7283.90 5145.79 17476.27 00:18:38.599 00:18:38.599 Latency(us) 00:18:38.599 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.599 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:38.599 Nvme1n1 : 1.00 16512.50 64.50 0.00 0.00 7734.25 3519.53 19709.35 00:18:38.599 =================================================================================================================== 00:18:38.599 Total : 16512.50 64.50 0.00 0.00 7734.25 3519.53 19709.35 00:18:38.599 00:18:38.599 Latency(us) 00:18:38.599 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:38.599 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:38.599 Nvme1n1 : 1.00 283684.43 1108.14 0.00 0.00 449.76 175.98 1674.81 00:18:38.599 =================================================================================================================== 00:18:38.599 Total : 283684.43 1108.14 0.00 0.00 449.76 175.98 1674.81 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@38 -- # wait 318292 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@39 -- # wait 318294 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@40 -- # wait 318297 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:38.859 00:52:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:38.859 00:52:45 -- common/autotest_common.sh@10 -- # set +x 00:18:38.859 00:52:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:38.859 00:52:45 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:38.859 00:52:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:38.859 00:52:45 -- nvmf/common.sh@117 -- # sync 00:18:38.859 00:52:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:38.859 00:52:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:38.859 00:52:45 -- nvmf/common.sh@120 -- # set +e 00:18:38.859 00:52:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:38.859 00:52:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:38.859 rmmod nvme_rdma 00:18:38.859 rmmod nvme_fabrics 00:18:38.859 00:52:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:38.859 00:52:46 -- nvmf/common.sh@124 -- # set -e 00:18:38.859 00:52:46 -- nvmf/common.sh@125 -- # return 0 00:18:38.859 00:52:46 -- nvmf/common.sh@478 -- # '[' -n 318168 ']' 00:18:38.859 00:52:46 -- nvmf/common.sh@479 -- # killprocess 318168 00:18:38.859 00:52:46 -- common/autotest_common.sh@936 -- # '[' -z 318168 ']' 00:18:38.859 00:52:46 -- common/autotest_common.sh@940 -- # kill -0 318168 00:18:38.859 00:52:46 -- common/autotest_common.sh@941 -- # uname 00:18:38.859 00:52:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:38.859 00:52:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318168 00:18:38.859 00:52:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:38.859 00:52:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:38.859 00:52:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318168' 00:18:38.859 killing process with pid 318168 00:18:38.859 00:52:46 -- common/autotest_common.sh@955 -- # kill 318168 00:18:38.859 00:52:46 -- common/autotest_common.sh@960 -- # wait 318168 00:18:39.119 [2024-04-26 00:52:46.122210] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:39.119 00:52:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:39.119 00:52:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:39.119 00:18:39.119 real 0m8.963s 00:18:39.119 user 0m20.002s 00:18:39.119 sys 0m5.306s 00:18:39.119 00:52:46 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:39.119 00:52:46 -- common/autotest_common.sh@10 -- # set +x 00:18:39.119 ************************************ 00:18:39.378 END TEST nvmf_bdev_io_wait 00:18:39.378 ************************************ 00:18:39.378 00:52:46 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:39.378 00:52:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:39.378 00:52:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:39.378 00:52:46 -- common/autotest_common.sh@10 -- # set +x 00:18:39.378 ************************************ 00:18:39.378 START TEST nvmf_queue_depth 00:18:39.378 ************************************ 00:18:39.378 00:52:46 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:18:39.378 * Looking for test storage... 00:18:39.637 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:39.637 00:52:46 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:39.637 00:52:46 -- nvmf/common.sh@7 -- # uname -s 00:18:39.637 00:52:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:39.637 00:52:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:39.637 00:52:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:39.637 00:52:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:39.637 00:52:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:39.637 00:52:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:39.637 00:52:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:39.637 00:52:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:39.637 00:52:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:39.637 00:52:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:39.637 00:52:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:39.637 00:52:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:39.637 00:52:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:39.637 00:52:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:39.637 00:52:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:39.637 00:52:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:39.637 00:52:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:39.637 00:52:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:39.637 00:52:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:39.637 00:52:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:39.637 00:52:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.637 00:52:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.637 00:52:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.637 00:52:46 -- paths/export.sh@5 -- # export PATH 00:18:39.637 00:52:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.637 00:52:46 -- nvmf/common.sh@47 -- # : 0 00:18:39.637 00:52:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:39.637 00:52:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:39.637 00:52:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:39.637 00:52:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:39.637 00:52:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:39.637 00:52:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:39.637 00:52:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:39.637 00:52:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:39.637 00:52:46 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:39.637 00:52:46 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:39.637 00:52:46 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:39.637 00:52:46 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:39.637 00:52:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:39.637 00:52:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:39.637 00:52:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:39.637 00:52:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:39.637 00:52:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:39.637 00:52:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.637 00:52:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.637 00:52:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.637 00:52:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:39.637 00:52:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:39.637 00:52:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:39.637 00:52:46 -- common/autotest_common.sh@10 -- # set +x 00:18:44.909 00:52:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:44.909 00:52:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:44.909 00:52:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:44.909 00:52:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:44.909 00:52:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:44.909 00:52:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:44.909 00:52:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:44.909 00:52:51 -- nvmf/common.sh@295 -- # net_devs=() 00:18:44.909 00:52:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:44.909 00:52:51 -- nvmf/common.sh@296 -- # e810=() 00:18:44.909 00:52:51 -- nvmf/common.sh@296 -- # local -ga e810 00:18:44.909 00:52:51 -- nvmf/common.sh@297 -- # x722=() 00:18:44.909 00:52:51 -- nvmf/common.sh@297 -- # local -ga x722 00:18:44.909 00:52:51 -- nvmf/common.sh@298 -- # mlx=() 00:18:44.909 00:52:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:44.909 00:52:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:44.909 00:52:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:44.909 00:52:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:44.909 00:52:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:44.909 00:52:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:44.909 00:52:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:44.909 00:52:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:44.909 00:52:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:44.909 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:44.909 00:52:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:44.909 00:52:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:44.909 00:52:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:44.910 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:44.910 00:52:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:44.910 00:52:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.910 00:52:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.910 00:52:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:44.910 Found net devices under 0000:18:00.0: mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.910 00:52:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.910 00:52:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.910 00:52:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:44.910 Found net devices under 0000:18:00.1: mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.910 00:52:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:44.910 00:52:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:44.910 00:52:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:44.910 00:52:51 -- nvmf/common.sh@58 -- # uname 00:18:44.910 00:52:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:44.910 00:52:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:44.910 00:52:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:44.910 00:52:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:44.910 00:52:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:44.910 00:52:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:44.910 00:52:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:44.910 00:52:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:44.910 00:52:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:44.910 00:52:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:44.910 00:52:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:44.910 00:52:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:44.910 00:52:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:44.910 00:52:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:44.910 00:52:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:44.910 00:52:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@105 -- # continue 2 00:18:44.910 00:52:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@105 -- # continue 2 00:18:44.910 00:52:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:44.910 00:52:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:44.910 00:52:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:44.910 00:52:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:44.910 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:44.910 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:18:44.910 altname enp24s0f0np0 00:18:44.910 altname ens785f0np0 00:18:44.910 inet 192.168.100.8/24 scope global mlx_0_0 00:18:44.910 valid_lft forever preferred_lft forever 00:18:44.910 00:52:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:44.910 00:52:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:44.910 00:52:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:44.910 00:52:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:44.910 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:44.910 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:18:44.910 altname enp24s0f1np1 00:18:44.910 altname ens785f1np1 00:18:44.910 inet 192.168.100.9/24 scope global mlx_0_1 00:18:44.910 valid_lft forever preferred_lft forever 00:18:44.910 00:52:51 -- nvmf/common.sh@411 -- # return 0 00:18:44.910 00:52:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:44.910 00:52:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:44.910 00:52:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:44.910 00:52:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:44.910 00:52:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:44.910 00:52:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:44.910 00:52:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:44.910 00:52:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:44.910 00:52:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:44.910 00:52:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@105 -- # continue 2 00:18:44.910 00:52:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:44.910 00:52:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:44.910 00:52:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@105 -- # continue 2 00:18:44.910 00:52:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:44.910 00:52:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:44.910 00:52:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:44.910 00:52:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:44.910 00:52:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:44.910 00:52:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:44.910 192.168.100.9' 00:18:44.910 00:52:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:44.910 192.168.100.9' 00:18:44.910 00:52:51 -- nvmf/common.sh@446 -- # head -n 1 00:18:44.910 00:52:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:44.910 00:52:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:44.910 192.168.100.9' 00:18:44.910 00:52:51 -- nvmf/common.sh@447 -- # tail -n +2 00:18:44.910 00:52:51 -- nvmf/common.sh@447 -- # head -n 1 00:18:44.910 00:52:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:44.910 00:52:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:44.910 00:52:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:44.910 00:52:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:44.910 00:52:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:44.910 00:52:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:44.910 00:52:51 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:44.910 00:52:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:44.910 00:52:51 -- common/autotest_common.sh@710 -- # xtrace_disable 00:18:44.910 00:52:51 -- common/autotest_common.sh@10 -- # set +x 00:18:44.910 00:52:51 -- nvmf/common.sh@470 -- # nvmfpid=322084 00:18:44.910 00:52:51 -- nvmf/common.sh@471 -- # waitforlisten 322084 00:18:44.910 00:52:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:44.910 00:52:51 -- common/autotest_common.sh@817 -- # '[' -z 322084 ']' 00:18:44.910 00:52:51 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:44.910 00:52:51 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:44.910 00:52:51 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:44.910 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:44.910 00:52:51 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:44.910 00:52:51 -- common/autotest_common.sh@10 -- # set +x 00:18:44.910 [2024-04-26 00:52:51.916782] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:44.910 [2024-04-26 00:52:51.916827] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:44.910 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.910 [2024-04-26 00:52:51.967321] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.910 [2024-04-26 00:52:52.031680] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:44.910 [2024-04-26 00:52:52.031721] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:44.910 [2024-04-26 00:52:52.031728] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:44.910 [2024-04-26 00:52:52.031733] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:44.910 [2024-04-26 00:52:52.031737] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:44.910 [2024-04-26 00:52:52.031768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:45.846 00:52:52 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:45.846 00:52:52 -- common/autotest_common.sh@850 -- # return 0 00:18:45.846 00:52:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:45.846 00:52:52 -- common/autotest_common.sh@716 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 00:52:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:45.846 00:52:52 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:45.846 00:52:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 [2024-04-26 00:52:52.737537] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2312a10/0x2316f00) succeed. 00:18:45.846 [2024-04-26 00:52:52.745562] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2313f10/0x2358590) succeed. 00:18:45.846 00:52:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:45.846 00:52:52 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:45.846 00:52:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 Malloc0 00:18:45.846 00:52:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:45.846 00:52:52 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:45.846 00:52:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 00:52:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:45.846 00:52:52 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:45.846 00:52:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 00:52:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:45.846 00:52:52 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:45.846 00:52:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 [2024-04-26 00:52:52.821729] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:45.846 00:52:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:45.846 00:52:52 -- target/queue_depth.sh@30 -- # bdevperf_pid=322125 00:18:45.846 00:52:52 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:45.846 00:52:52 -- target/queue_depth.sh@33 -- # waitforlisten 322125 /var/tmp/bdevperf.sock 00:18:45.846 00:52:52 -- common/autotest_common.sh@817 -- # '[' -z 322125 ']' 00:18:45.846 00:52:52 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:45.846 00:52:52 -- common/autotest_common.sh@822 -- # local max_retries=100 00:18:45.846 00:52:52 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:45.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:45.846 00:52:52 -- common/autotest_common.sh@826 -- # xtrace_disable 00:18:45.846 00:52:52 -- common/autotest_common.sh@10 -- # set +x 00:18:45.846 00:52:52 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:45.846 [2024-04-26 00:52:52.865349] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:18:45.846 [2024-04-26 00:52:52.865388] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid322125 ] 00:18:45.846 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.846 [2024-04-26 00:52:52.913680] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:45.846 [2024-04-26 00:52:52.985313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:46.784 00:52:53 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:18:46.784 00:52:53 -- common/autotest_common.sh@850 -- # return 0 00:18:46.784 00:52:53 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:46.784 00:52:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:18:46.784 00:52:53 -- common/autotest_common.sh@10 -- # set +x 00:18:46.784 NVMe0n1 00:18:46.784 00:52:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:18:46.784 00:52:53 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:46.784 Running I/O for 10 seconds... 00:18:56.769 00:18:56.769 Latency(us) 00:18:56.769 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:56.769 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:56.769 Verification LBA range: start 0x0 length 0x4000 00:18:56.769 NVMe0n1 : 10.03 19428.79 75.89 0.00 0.00 52564.95 5412.79 33593.27 00:18:56.769 =================================================================================================================== 00:18:56.769 Total : 19428.79 75.89 0.00 0.00 52564.95 5412.79 33593.27 00:18:56.769 0 00:18:56.769 00:53:03 -- target/queue_depth.sh@39 -- # killprocess 322125 00:18:56.769 00:53:03 -- common/autotest_common.sh@936 -- # '[' -z 322125 ']' 00:18:56.769 00:53:03 -- common/autotest_common.sh@940 -- # kill -0 322125 00:18:56.769 00:53:03 -- common/autotest_common.sh@941 -- # uname 00:18:56.769 00:53:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:56.769 00:53:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 322125 00:18:56.769 00:53:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:56.769 00:53:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:56.769 00:53:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 322125' 00:18:56.769 killing process with pid 322125 00:18:56.769 00:53:03 -- common/autotest_common.sh@955 -- # kill 322125 00:18:56.769 Received shutdown signal, test time was about 10.000000 seconds 00:18:56.769 00:18:56.769 Latency(us) 00:18:56.769 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:56.769 =================================================================================================================== 00:18:56.769 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:56.769 00:53:03 -- common/autotest_common.sh@960 -- # wait 322125 00:18:57.028 00:53:04 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:57.028 00:53:04 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:57.028 00:53:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:57.028 00:53:04 -- nvmf/common.sh@117 -- # sync 00:18:57.028 00:53:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:57.028 00:53:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:57.028 00:53:04 -- nvmf/common.sh@120 -- # set +e 00:18:57.028 00:53:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:57.028 00:53:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:57.028 rmmod nvme_rdma 00:18:57.028 rmmod nvme_fabrics 00:18:57.028 00:53:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:57.028 00:53:04 -- nvmf/common.sh@124 -- # set -e 00:18:57.028 00:53:04 -- nvmf/common.sh@125 -- # return 0 00:18:57.028 00:53:04 -- nvmf/common.sh@478 -- # '[' -n 322084 ']' 00:18:57.028 00:53:04 -- nvmf/common.sh@479 -- # killprocess 322084 00:18:57.028 00:53:04 -- common/autotest_common.sh@936 -- # '[' -z 322084 ']' 00:18:57.028 00:53:04 -- common/autotest_common.sh@940 -- # kill -0 322084 00:18:57.028 00:53:04 -- common/autotest_common.sh@941 -- # uname 00:18:57.028 00:53:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:57.028 00:53:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 322084 00:18:57.028 00:53:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:57.028 00:53:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:57.028 00:53:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 322084' 00:18:57.028 killing process with pid 322084 00:18:57.028 00:53:04 -- common/autotest_common.sh@955 -- # kill 322084 00:18:57.028 00:53:04 -- common/autotest_common.sh@960 -- # wait 322084 00:18:57.288 [2024-04-26 00:53:04.244788] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:57.288 00:53:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:57.288 00:53:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:57.288 00:18:57.288 real 0m17.971s 00:18:57.288 user 0m25.581s 00:18:57.288 sys 0m4.496s 00:18:57.288 00:53:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:18:57.288 00:53:04 -- common/autotest_common.sh@10 -- # set +x 00:18:57.288 ************************************ 00:18:57.288 END TEST nvmf_queue_depth 00:18:57.288 ************************************ 00:18:57.547 00:53:04 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:57.547 00:53:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:57.547 00:53:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:57.547 00:53:04 -- common/autotest_common.sh@10 -- # set +x 00:18:57.547 ************************************ 00:18:57.547 START TEST nvmf_multipath 00:18:57.547 ************************************ 00:18:57.547 00:53:04 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:18:57.547 * Looking for test storage... 00:18:57.547 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:57.547 00:53:04 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:57.547 00:53:04 -- nvmf/common.sh@7 -- # uname -s 00:18:57.547 00:53:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:57.547 00:53:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:57.547 00:53:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:57.547 00:53:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:57.547 00:53:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:57.547 00:53:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:57.547 00:53:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:57.547 00:53:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:57.547 00:53:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:57.547 00:53:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:57.547 00:53:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:18:57.547 00:53:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:18:57.547 00:53:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:57.547 00:53:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:57.547 00:53:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:57.547 00:53:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:57.547 00:53:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:57.547 00:53:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:57.547 00:53:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:57.547 00:53:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:57.547 00:53:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.547 00:53:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.547 00:53:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.547 00:53:04 -- paths/export.sh@5 -- # export PATH 00:18:57.547 00:53:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:57.547 00:53:04 -- nvmf/common.sh@47 -- # : 0 00:18:57.547 00:53:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:57.547 00:53:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:57.547 00:53:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:57.547 00:53:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:57.547 00:53:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:57.547 00:53:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:57.547 00:53:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:57.547 00:53:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:57.547 00:53:04 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:57.547 00:53:04 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:57.547 00:53:04 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:57.547 00:53:04 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:18:57.547 00:53:04 -- target/multipath.sh@43 -- # nvmftestinit 00:18:57.547 00:53:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:57.547 00:53:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:57.547 00:53:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:57.547 00:53:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:57.547 00:53:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:57.547 00:53:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:57.547 00:53:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:57.547 00:53:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:57.547 00:53:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:57.547 00:53:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:57.547 00:53:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:57.547 00:53:04 -- common/autotest_common.sh@10 -- # set +x 00:19:02.823 00:53:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:02.823 00:53:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:02.823 00:53:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:02.823 00:53:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:02.823 00:53:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:02.823 00:53:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:02.823 00:53:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:02.823 00:53:09 -- nvmf/common.sh@295 -- # net_devs=() 00:19:02.823 00:53:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:02.823 00:53:09 -- nvmf/common.sh@296 -- # e810=() 00:19:02.823 00:53:09 -- nvmf/common.sh@296 -- # local -ga e810 00:19:02.823 00:53:09 -- nvmf/common.sh@297 -- # x722=() 00:19:02.823 00:53:09 -- nvmf/common.sh@297 -- # local -ga x722 00:19:02.823 00:53:09 -- nvmf/common.sh@298 -- # mlx=() 00:19:02.823 00:53:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:02.823 00:53:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:02.823 00:53:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:02.823 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:02.823 00:53:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:02.823 00:53:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:02.823 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:02.823 00:53:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:02.823 00:53:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:02.823 00:53:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:02.823 00:53:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:02.823 Found net devices under 0000:18:00.0: mlx_0_0 00:19:02.823 00:53:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:02.823 00:53:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:02.823 00:53:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:02.823 Found net devices under 0000:18:00.1: mlx_0_1 00:19:02.823 00:53:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:02.823 00:53:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:02.823 00:53:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:02.823 00:53:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:02.823 00:53:09 -- nvmf/common.sh@58 -- # uname 00:19:02.823 00:53:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:02.823 00:53:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:02.823 00:53:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:02.823 00:53:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:02.823 00:53:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:02.823 00:53:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:02.823 00:53:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:02.823 00:53:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:02.823 00:53:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:02.823 00:53:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:02.823 00:53:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:02.823 00:53:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:02.823 00:53:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:02.823 00:53:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:02.823 00:53:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:02.823 00:53:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:02.823 00:53:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:02.823 00:53:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:02.823 00:53:09 -- nvmf/common.sh@105 -- # continue 2 00:19:02.823 00:53:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.823 00:53:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:02.824 00:53:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:02.824 00:53:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:02.824 00:53:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:02.824 00:53:09 -- nvmf/common.sh@105 -- # continue 2 00:19:02.824 00:53:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:02.824 00:53:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:02.824 00:53:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.824 00:53:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:02.824 00:53:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:02.824 00:53:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:02.824 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:02.824 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:02.824 altname enp24s0f0np0 00:19:02.824 altname ens785f0np0 00:19:02.824 inet 192.168.100.8/24 scope global mlx_0_0 00:19:02.824 valid_lft forever preferred_lft forever 00:19:02.824 00:53:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:02.824 00:53:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:02.824 00:53:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:02.824 00:53:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:02.824 00:53:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:02.824 00:53:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:02.824 00:53:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:02.824 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:02.824 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:02.824 altname enp24s0f1np1 00:19:02.824 altname ens785f1np1 00:19:02.824 inet 192.168.100.9/24 scope global mlx_0_1 00:19:02.824 valid_lft forever preferred_lft forever 00:19:02.824 00:53:10 -- nvmf/common.sh@411 -- # return 0 00:19:02.824 00:53:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:02.824 00:53:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:02.824 00:53:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:02.824 00:53:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:02.824 00:53:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:02.824 00:53:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:03.083 00:53:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:03.083 00:53:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:03.083 00:53:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:03.083 00:53:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:03.083 00:53:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:03.083 00:53:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:03.083 00:53:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:03.083 00:53:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:03.083 00:53:10 -- nvmf/common.sh@105 -- # continue 2 00:19:03.083 00:53:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:03.083 00:53:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:03.083 00:53:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:03.083 00:53:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:03.083 00:53:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:03.083 00:53:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:03.083 00:53:10 -- nvmf/common.sh@105 -- # continue 2 00:19:03.083 00:53:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:03.083 00:53:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:03.083 00:53:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:03.083 00:53:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:03.083 00:53:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:03.083 00:53:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:03.083 00:53:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:03.083 00:53:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:03.083 192.168.100.9' 00:19:03.083 00:53:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:03.083 192.168.100.9' 00:19:03.083 00:53:10 -- nvmf/common.sh@446 -- # head -n 1 00:19:03.083 00:53:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:03.083 00:53:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:03.083 192.168.100.9' 00:19:03.083 00:53:10 -- nvmf/common.sh@447 -- # tail -n +2 00:19:03.083 00:53:10 -- nvmf/common.sh@447 -- # head -n 1 00:19:03.083 00:53:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:03.083 00:53:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:03.083 00:53:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:03.083 00:53:10 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:19:03.083 00:53:10 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:19:03.083 00:53:10 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:19:03.083 run this test only with TCP transport for now 00:19:03.083 00:53:10 -- target/multipath.sh@53 -- # nvmftestfini 00:19:03.083 00:53:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:03.083 00:53:10 -- nvmf/common.sh@117 -- # sync 00:19:03.083 00:53:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@120 -- # set +e 00:19:03.083 00:53:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:03.083 00:53:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:03.083 rmmod nvme_rdma 00:19:03.083 rmmod nvme_fabrics 00:19:03.083 00:53:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:03.083 00:53:10 -- nvmf/common.sh@124 -- # set -e 00:19:03.083 00:53:10 -- nvmf/common.sh@125 -- # return 0 00:19:03.083 00:53:10 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:03.083 00:53:10 -- target/multipath.sh@54 -- # exit 0 00:19:03.083 00:53:10 -- target/multipath.sh@1 -- # nvmftestfini 00:19:03.083 00:53:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:03.083 00:53:10 -- nvmf/common.sh@117 -- # sync 00:19:03.083 00:53:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@120 -- # set +e 00:19:03.083 00:53:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:03.083 00:53:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:03.083 00:53:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:03.083 00:53:10 -- nvmf/common.sh@124 -- # set -e 00:19:03.083 00:53:10 -- nvmf/common.sh@125 -- # return 0 00:19:03.083 00:53:10 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:03.083 00:53:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:03.083 00:19:03.083 real 0m5.538s 00:19:03.083 user 0m1.581s 00:19:03.083 sys 0m4.098s 00:19:03.083 00:53:10 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:03.083 00:53:10 -- common/autotest_common.sh@10 -- # set +x 00:19:03.083 ************************************ 00:19:03.083 END TEST nvmf_multipath 00:19:03.083 ************************************ 00:19:03.083 00:53:10 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:19:03.083 00:53:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:03.083 00:53:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:03.083 00:53:10 -- common/autotest_common.sh@10 -- # set +x 00:19:03.343 ************************************ 00:19:03.343 START TEST nvmf_zcopy 00:19:03.343 ************************************ 00:19:03.343 00:53:10 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:19:03.343 * Looking for test storage... 00:19:03.343 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:03.343 00:53:10 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:03.343 00:53:10 -- nvmf/common.sh@7 -- # uname -s 00:19:03.343 00:53:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:03.343 00:53:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:03.343 00:53:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:03.343 00:53:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:03.343 00:53:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:03.343 00:53:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:03.343 00:53:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:03.343 00:53:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:03.343 00:53:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:03.343 00:53:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:03.343 00:53:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:03.343 00:53:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:03.343 00:53:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:03.343 00:53:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:03.343 00:53:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:03.343 00:53:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:03.343 00:53:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:03.343 00:53:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:03.343 00:53:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:03.343 00:53:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:03.343 00:53:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.343 00:53:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.343 00:53:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.343 00:53:10 -- paths/export.sh@5 -- # export PATH 00:19:03.343 00:53:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.343 00:53:10 -- nvmf/common.sh@47 -- # : 0 00:19:03.343 00:53:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:03.343 00:53:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:03.343 00:53:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:03.343 00:53:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:03.343 00:53:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:03.343 00:53:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:03.343 00:53:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:03.343 00:53:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:03.343 00:53:10 -- target/zcopy.sh@12 -- # nvmftestinit 00:19:03.343 00:53:10 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:03.343 00:53:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:03.343 00:53:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:03.343 00:53:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:03.343 00:53:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:03.343 00:53:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.343 00:53:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.343 00:53:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.343 00:53:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:03.343 00:53:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:03.343 00:53:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:03.343 00:53:10 -- common/autotest_common.sh@10 -- # set +x 00:19:08.620 00:53:15 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:08.620 00:53:15 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:08.620 00:53:15 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:08.620 00:53:15 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:08.620 00:53:15 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:08.620 00:53:15 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:08.620 00:53:15 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:08.620 00:53:15 -- nvmf/common.sh@295 -- # net_devs=() 00:19:08.620 00:53:15 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:08.620 00:53:15 -- nvmf/common.sh@296 -- # e810=() 00:19:08.620 00:53:15 -- nvmf/common.sh@296 -- # local -ga e810 00:19:08.620 00:53:15 -- nvmf/common.sh@297 -- # x722=() 00:19:08.620 00:53:15 -- nvmf/common.sh@297 -- # local -ga x722 00:19:08.620 00:53:15 -- nvmf/common.sh@298 -- # mlx=() 00:19:08.620 00:53:15 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:08.620 00:53:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:08.620 00:53:15 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:08.620 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:08.620 00:53:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:08.620 00:53:15 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:08.620 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:08.620 00:53:15 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:08.620 00:53:15 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.620 00:53:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.620 00:53:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:08.620 Found net devices under 0000:18:00.0: mlx_0_0 00:19:08.620 00:53:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:08.620 00:53:15 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:08.620 00:53:15 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:08.620 Found net devices under 0000:18:00.1: mlx_0_1 00:19:08.620 00:53:15 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:08.620 00:53:15 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:08.620 00:53:15 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:08.620 00:53:15 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:08.620 00:53:15 -- nvmf/common.sh@58 -- # uname 00:19:08.620 00:53:15 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:08.620 00:53:15 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:08.620 00:53:15 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:08.620 00:53:15 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:08.620 00:53:15 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:08.620 00:53:15 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:08.620 00:53:15 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:08.620 00:53:15 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:08.620 00:53:15 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:08.620 00:53:15 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:08.620 00:53:15 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:08.620 00:53:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:08.620 00:53:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:08.620 00:53:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:08.620 00:53:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:08.620 00:53:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:08.620 00:53:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:08.620 00:53:15 -- nvmf/common.sh@105 -- # continue 2 00:19:08.620 00:53:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.620 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:08.620 00:53:15 -- nvmf/common.sh@105 -- # continue 2 00:19:08.620 00:53:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:08.620 00:53:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:08.620 00:53:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:08.620 00:53:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:08.620 00:53:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.620 00:53:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.620 00:53:15 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:08.620 00:53:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:08.620 00:53:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:08.621 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:08.621 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:08.621 altname enp24s0f0np0 00:19:08.621 altname ens785f0np0 00:19:08.621 inet 192.168.100.8/24 scope global mlx_0_0 00:19:08.621 valid_lft forever preferred_lft forever 00:19:08.621 00:53:15 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:08.621 00:53:15 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:08.621 00:53:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:08.621 00:53:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:08.621 00:53:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.621 00:53:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.621 00:53:15 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:08.621 00:53:15 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:08.621 00:53:15 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:08.621 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:08.621 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:08.621 altname enp24s0f1np1 00:19:08.621 altname ens785f1np1 00:19:08.621 inet 192.168.100.9/24 scope global mlx_0_1 00:19:08.621 valid_lft forever preferred_lft forever 00:19:08.621 00:53:15 -- nvmf/common.sh@411 -- # return 0 00:19:08.621 00:53:15 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:08.621 00:53:15 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:08.621 00:53:15 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:08.621 00:53:15 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:08.621 00:53:15 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:08.621 00:53:15 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:08.621 00:53:15 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:08.621 00:53:15 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:08.621 00:53:15 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:08.881 00:53:15 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:08.881 00:53:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.881 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.881 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:08.881 00:53:15 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:08.881 00:53:15 -- nvmf/common.sh@105 -- # continue 2 00:19:08.881 00:53:15 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:08.881 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.881 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:08.881 00:53:15 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:08.881 00:53:15 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:08.881 00:53:15 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:08.881 00:53:15 -- nvmf/common.sh@105 -- # continue 2 00:19:08.881 00:53:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:08.881 00:53:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:08.881 00:53:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.881 00:53:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:08.881 00:53:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:08.881 00:53:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:08.881 00:53:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:08.881 00:53:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:08.881 192.168.100.9' 00:19:08.881 00:53:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:08.881 192.168.100.9' 00:19:08.881 00:53:15 -- nvmf/common.sh@446 -- # head -n 1 00:19:08.881 00:53:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:08.881 00:53:15 -- nvmf/common.sh@447 -- # head -n 1 00:19:08.881 00:53:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:08.881 192.168.100.9' 00:19:08.881 00:53:15 -- nvmf/common.sh@447 -- # tail -n +2 00:19:08.881 00:53:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:08.881 00:53:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:08.881 00:53:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:08.881 00:53:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:08.881 00:53:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:08.881 00:53:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:08.881 00:53:15 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:19:08.881 00:53:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:08.881 00:53:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:08.881 00:53:15 -- common/autotest_common.sh@10 -- # set +x 00:19:08.881 00:53:15 -- nvmf/common.sh@470 -- # nvmfpid=330693 00:19:08.881 00:53:15 -- nvmf/common.sh@471 -- # waitforlisten 330693 00:19:08.881 00:53:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:08.881 00:53:15 -- common/autotest_common.sh@817 -- # '[' -z 330693 ']' 00:19:08.881 00:53:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:08.881 00:53:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:08.881 00:53:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:08.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:08.881 00:53:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:08.881 00:53:15 -- common/autotest_common.sh@10 -- # set +x 00:19:08.881 [2024-04-26 00:53:15.940038] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:19:08.881 [2024-04-26 00:53:15.940081] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:08.881 EAL: No free 2048 kB hugepages reported on node 1 00:19:08.881 [2024-04-26 00:53:15.990474] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:08.881 [2024-04-26 00:53:16.055311] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:08.881 [2024-04-26 00:53:16.055349] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:08.881 [2024-04-26 00:53:16.055355] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:08.881 [2024-04-26 00:53:16.055360] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:08.881 [2024-04-26 00:53:16.055365] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:08.881 [2024-04-26 00:53:16.055399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:09.821 00:53:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:09.821 00:53:16 -- common/autotest_common.sh@850 -- # return 0 00:19:09.821 00:53:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:09.821 00:53:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:09.821 00:53:16 -- common/autotest_common.sh@10 -- # set +x 00:19:09.821 00:53:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:09.821 00:53:16 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:19:09.821 00:53:16 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:19:09.821 Unsupported transport: rdma 00:19:09.821 00:53:16 -- target/zcopy.sh@17 -- # exit 0 00:19:09.821 00:53:16 -- target/zcopy.sh@1 -- # process_shm --id 0 00:19:09.821 00:53:16 -- common/autotest_common.sh@794 -- # type=--id 00:19:09.821 00:53:16 -- common/autotest_common.sh@795 -- # id=0 00:19:09.821 00:53:16 -- common/autotest_common.sh@796 -- # '[' --id = --pid ']' 00:19:09.821 00:53:16 -- common/autotest_common.sh@800 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:19:09.821 00:53:16 -- common/autotest_common.sh@800 -- # shm_files=nvmf_trace.0 00:19:09.821 00:53:16 -- common/autotest_common.sh@802 -- # [[ -z nvmf_trace.0 ]] 00:19:09.821 00:53:16 -- common/autotest_common.sh@806 -- # for n in $shm_files 00:19:09.821 00:53:16 -- common/autotest_common.sh@807 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:19:09.821 nvmf_trace.0 00:19:09.821 00:53:16 -- common/autotest_common.sh@809 -- # return 0 00:19:09.821 00:53:16 -- target/zcopy.sh@1 -- # nvmftestfini 00:19:09.821 00:53:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:09.821 00:53:16 -- nvmf/common.sh@117 -- # sync 00:19:09.821 00:53:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:09.821 00:53:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:09.821 00:53:16 -- nvmf/common.sh@120 -- # set +e 00:19:09.821 00:53:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:09.821 00:53:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:09.821 rmmod nvme_rdma 00:19:09.821 rmmod nvme_fabrics 00:19:09.821 00:53:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:09.821 00:53:16 -- nvmf/common.sh@124 -- # set -e 00:19:09.821 00:53:16 -- nvmf/common.sh@125 -- # return 0 00:19:09.821 00:53:16 -- nvmf/common.sh@478 -- # '[' -n 330693 ']' 00:19:09.821 00:53:16 -- nvmf/common.sh@479 -- # killprocess 330693 00:19:09.821 00:53:16 -- common/autotest_common.sh@936 -- # '[' -z 330693 ']' 00:19:09.821 00:53:16 -- common/autotest_common.sh@940 -- # kill -0 330693 00:19:09.821 00:53:16 -- common/autotest_common.sh@941 -- # uname 00:19:09.821 00:53:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:09.821 00:53:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 330693 00:19:09.821 00:53:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:09.821 00:53:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:09.821 00:53:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 330693' 00:19:09.821 killing process with pid 330693 00:19:09.821 00:53:16 -- common/autotest_common.sh@955 -- # kill 330693 00:19:09.821 00:53:16 -- common/autotest_common.sh@960 -- # wait 330693 00:19:10.081 00:53:17 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:10.081 00:53:17 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:10.081 00:19:10.081 real 0m6.739s 00:19:10.081 user 0m2.878s 00:19:10.081 sys 0m4.451s 00:19:10.081 00:53:17 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:10.081 00:53:17 -- common/autotest_common.sh@10 -- # set +x 00:19:10.081 ************************************ 00:19:10.081 END TEST nvmf_zcopy 00:19:10.081 ************************************ 00:19:10.081 00:53:17 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:19:10.081 00:53:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:10.081 00:53:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:10.081 00:53:17 -- common/autotest_common.sh@10 -- # set +x 00:19:10.081 ************************************ 00:19:10.082 START TEST nvmf_nmic 00:19:10.082 ************************************ 00:19:10.082 00:53:17 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:19:10.341 * Looking for test storage... 00:19:10.341 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:10.341 00:53:17 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:10.341 00:53:17 -- nvmf/common.sh@7 -- # uname -s 00:19:10.341 00:53:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:10.341 00:53:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:10.341 00:53:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:10.341 00:53:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:10.341 00:53:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:10.341 00:53:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:10.341 00:53:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:10.341 00:53:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:10.341 00:53:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:10.341 00:53:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:10.341 00:53:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:10.341 00:53:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:10.341 00:53:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:10.341 00:53:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:10.341 00:53:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:10.341 00:53:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:10.342 00:53:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:10.342 00:53:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:10.342 00:53:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:10.342 00:53:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:10.342 00:53:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.342 00:53:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.342 00:53:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.342 00:53:17 -- paths/export.sh@5 -- # export PATH 00:19:10.342 00:53:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.342 00:53:17 -- nvmf/common.sh@47 -- # : 0 00:19:10.342 00:53:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:10.342 00:53:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:10.342 00:53:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:10.342 00:53:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:10.342 00:53:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:10.342 00:53:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:10.342 00:53:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:10.342 00:53:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:10.342 00:53:17 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:10.342 00:53:17 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:10.342 00:53:17 -- target/nmic.sh@14 -- # nvmftestinit 00:19:10.342 00:53:17 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:10.342 00:53:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:10.342 00:53:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:10.342 00:53:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:10.342 00:53:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:10.342 00:53:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:10.342 00:53:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:10.342 00:53:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:10.342 00:53:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:10.342 00:53:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:10.342 00:53:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:10.342 00:53:17 -- common/autotest_common.sh@10 -- # set +x 00:19:15.624 00:53:22 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:15.624 00:53:22 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:15.624 00:53:22 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:15.625 00:53:22 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:15.625 00:53:22 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:15.625 00:53:22 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:15.625 00:53:22 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:15.625 00:53:22 -- nvmf/common.sh@295 -- # net_devs=() 00:19:15.625 00:53:22 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:15.625 00:53:22 -- nvmf/common.sh@296 -- # e810=() 00:19:15.625 00:53:22 -- nvmf/common.sh@296 -- # local -ga e810 00:19:15.625 00:53:22 -- nvmf/common.sh@297 -- # x722=() 00:19:15.625 00:53:22 -- nvmf/common.sh@297 -- # local -ga x722 00:19:15.625 00:53:22 -- nvmf/common.sh@298 -- # mlx=() 00:19:15.625 00:53:22 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:15.625 00:53:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:15.625 00:53:22 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:15.625 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:15.625 00:53:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:15.625 00:53:22 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:15.625 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:15.625 00:53:22 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:15.625 00:53:22 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.625 00:53:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.625 00:53:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:15.625 Found net devices under 0000:18:00.0: mlx_0_0 00:19:15.625 00:53:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.625 00:53:22 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.625 00:53:22 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:15.625 Found net devices under 0000:18:00.1: mlx_0_1 00:19:15.625 00:53:22 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.625 00:53:22 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:15.625 00:53:22 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:15.625 00:53:22 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:15.625 00:53:22 -- nvmf/common.sh@58 -- # uname 00:19:15.625 00:53:22 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:15.625 00:53:22 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:15.625 00:53:22 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:15.625 00:53:22 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:15.625 00:53:22 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:15.625 00:53:22 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:15.625 00:53:22 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:15.625 00:53:22 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:15.625 00:53:22 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:15.625 00:53:22 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:15.625 00:53:22 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:15.625 00:53:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:15.625 00:53:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:15.625 00:53:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:15.625 00:53:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:15.625 00:53:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:15.625 00:53:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:15.625 00:53:22 -- nvmf/common.sh@105 -- # continue 2 00:19:15.625 00:53:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.625 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:15.625 00:53:22 -- nvmf/common.sh@105 -- # continue 2 00:19:15.625 00:53:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:15.625 00:53:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:15.625 00:53:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.625 00:53:22 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:15.625 00:53:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:15.625 00:53:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:15.625 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:15.625 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:15.625 altname enp24s0f0np0 00:19:15.625 altname ens785f0np0 00:19:15.625 inet 192.168.100.8/24 scope global mlx_0_0 00:19:15.625 valid_lft forever preferred_lft forever 00:19:15.625 00:53:22 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:15.625 00:53:22 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:15.625 00:53:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.625 00:53:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.625 00:53:22 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:15.625 00:53:22 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:15.626 00:53:22 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:15.626 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:15.626 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:15.626 altname enp24s0f1np1 00:19:15.626 altname ens785f1np1 00:19:15.626 inet 192.168.100.9/24 scope global mlx_0_1 00:19:15.626 valid_lft forever preferred_lft forever 00:19:15.626 00:53:22 -- nvmf/common.sh@411 -- # return 0 00:19:15.626 00:53:22 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:15.626 00:53:22 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:15.626 00:53:22 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:15.626 00:53:22 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:15.626 00:53:22 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:15.626 00:53:22 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:15.626 00:53:22 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:15.626 00:53:22 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:15.626 00:53:22 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:15.626 00:53:22 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:15.626 00:53:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.626 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.626 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:15.626 00:53:22 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:15.626 00:53:22 -- nvmf/common.sh@105 -- # continue 2 00:19:15.626 00:53:22 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:15.626 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.626 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:15.626 00:53:22 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:15.626 00:53:22 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:15.626 00:53:22 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:15.626 00:53:22 -- nvmf/common.sh@105 -- # continue 2 00:19:15.626 00:53:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:15.626 00:53:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:15.626 00:53:22 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.626 00:53:22 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:15.626 00:53:22 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:15.626 00:53:22 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:15.626 00:53:22 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:15.626 00:53:22 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:15.626 192.168.100.9' 00:19:15.626 00:53:22 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:15.626 192.168.100.9' 00:19:15.626 00:53:22 -- nvmf/common.sh@446 -- # head -n 1 00:19:15.626 00:53:22 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:15.626 00:53:22 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:15.626 192.168.100.9' 00:19:15.626 00:53:22 -- nvmf/common.sh@447 -- # tail -n +2 00:19:15.626 00:53:22 -- nvmf/common.sh@447 -- # head -n 1 00:19:15.626 00:53:22 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:15.626 00:53:22 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:15.626 00:53:22 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:15.626 00:53:22 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:15.626 00:53:22 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:15.626 00:53:22 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:15.626 00:53:22 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:15.626 00:53:22 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:15.626 00:53:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:15.626 00:53:22 -- common/autotest_common.sh@10 -- # set +x 00:19:15.626 00:53:22 -- nvmf/common.sh@470 -- # nvmfpid=334168 00:19:15.626 00:53:22 -- nvmf/common.sh@471 -- # waitforlisten 334168 00:19:15.626 00:53:22 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:15.626 00:53:22 -- common/autotest_common.sh@817 -- # '[' -z 334168 ']' 00:19:15.626 00:53:22 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:15.626 00:53:22 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:15.626 00:53:22 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:15.626 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:15.626 00:53:22 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:15.626 00:53:22 -- common/autotest_common.sh@10 -- # set +x 00:19:15.626 [2024-04-26 00:53:22.567589] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:19:15.626 [2024-04-26 00:53:22.567631] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:15.626 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.626 [2024-04-26 00:53:22.618049] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:15.626 [2024-04-26 00:53:22.691429] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:15.626 [2024-04-26 00:53:22.691461] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:15.626 [2024-04-26 00:53:22.691467] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:15.626 [2024-04-26 00:53:22.691473] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:15.626 [2024-04-26 00:53:22.691477] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:15.626 [2024-04-26 00:53:22.691516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:15.626 [2024-04-26 00:53:22.691531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:15.626 [2024-04-26 00:53:22.691622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:15.626 [2024-04-26 00:53:22.691624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:16.194 00:53:23 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:16.194 00:53:23 -- common/autotest_common.sh@850 -- # return 0 00:19:16.194 00:53:23 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:16.194 00:53:23 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:16.194 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.194 00:53:23 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:16.194 00:53:23 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:16.194 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.194 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 [2024-04-26 00:53:23.411149] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x172b880/0x172fd70) succeed. 00:19:16.453 [2024-04-26 00:53:23.420444] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x172cec0/0x1771400) succeed. 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 Malloc0 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 [2024-04-26 00:53:23.571650] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:16.453 test case1: single bdev can't be used in multiple subsystems 00:19:16.453 00:53:23 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@28 -- # nmic_status=0 00:19:16.453 00:53:23 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 [2024-04-26 00:53:23.595421] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:16.453 [2024-04-26 00:53:23.595439] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:16.453 [2024-04-26 00:53:23.595446] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.453 request: 00:19:16.453 { 00:19:16.453 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:16.453 "namespace": { 00:19:16.453 "bdev_name": "Malloc0", 00:19:16.453 "no_auto_visible": false 00:19:16.453 }, 00:19:16.453 "method": "nvmf_subsystem_add_ns", 00:19:16.453 "req_id": 1 00:19:16.453 } 00:19:16.453 Got JSON-RPC error response 00:19:16.453 response: 00:19:16.453 { 00:19:16.453 "code": -32602, 00:19:16.453 "message": "Invalid parameters" 00:19:16.453 } 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@29 -- # nmic_status=1 00:19:16.453 00:53:23 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:16.453 00:53:23 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:16.453 Adding namespace failed - expected result. 00:19:16.453 00:53:23 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:16.453 test case2: host connect to nvmf target in multiple paths 00:19:16.453 00:53:23 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:19:16.453 00:53:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:16.453 00:53:23 -- common/autotest_common.sh@10 -- # set +x 00:19:16.453 [2024-04-26 00:53:23.607465] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:16.453 00:53:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:16.453 00:53:23 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:17.392 00:53:24 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:19:18.329 00:53:25 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:18.329 00:53:25 -- common/autotest_common.sh@1184 -- # local i=0 00:19:18.329 00:53:25 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:18.329 00:53:25 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:19:18.329 00:53:25 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:20.869 00:53:27 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:20.869 00:53:27 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:20.869 00:53:27 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:20.869 00:53:27 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:19:20.869 00:53:27 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:20.869 00:53:27 -- common/autotest_common.sh@1194 -- # return 0 00:19:20.869 00:53:27 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:20.869 [global] 00:19:20.869 thread=1 00:19:20.869 invalidate=1 00:19:20.869 rw=write 00:19:20.869 time_based=1 00:19:20.869 runtime=1 00:19:20.869 ioengine=libaio 00:19:20.869 direct=1 00:19:20.869 bs=4096 00:19:20.869 iodepth=1 00:19:20.869 norandommap=0 00:19:20.869 numjobs=1 00:19:20.869 00:19:20.869 verify_dump=1 00:19:20.869 verify_backlog=512 00:19:20.869 verify_state_save=0 00:19:20.869 do_verify=1 00:19:20.869 verify=crc32c-intel 00:19:20.869 [job0] 00:19:20.869 filename=/dev/nvme0n1 00:19:20.869 Could not set queue depth (nvme0n1) 00:19:20.869 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:20.869 fio-3.35 00:19:20.869 Starting 1 thread 00:19:22.250 00:19:22.250 job0: (groupid=0, jobs=1): err= 0: pid=335185: Fri Apr 26 00:53:29 2024 00:19:22.250 read: IOPS=7841, BW=30.6MiB/s (32.1MB/s)(30.7MiB/1001msec) 00:19:22.250 slat (nsec): min=6064, max=24595, avg=6702.24, stdev=674.06 00:19:22.250 clat (usec): min=37, max=153, avg=53.79, stdev= 3.74 00:19:22.250 lat (usec): min=51, max=160, avg=60.49, stdev= 3.77 00:19:22.250 clat percentiles (usec): 00:19:22.250 | 1.00th=[ 47], 5.00th=[ 49], 10.00th=[ 50], 20.00th=[ 51], 00:19:22.250 | 30.00th=[ 52], 40.00th=[ 53], 50.00th=[ 54], 60.00th=[ 55], 00:19:22.250 | 70.00th=[ 56], 80.00th=[ 58], 90.00th=[ 59], 95.00th=[ 60], 00:19:22.250 | 99.00th=[ 63], 99.50th=[ 64], 99.90th=[ 69], 99.95th=[ 71], 00:19:22.250 | 99.99th=[ 153] 00:19:22.250 write: IOPS=8183, BW=32.0MiB/s (33.5MB/s)(32.0MiB/1001msec); 0 zone resets 00:19:22.250 slat (nsec): min=7956, max=50044, avg=8761.27, stdev=969.98 00:19:22.250 clat (nsec): min=29209, max=70538, avg=51497.20, stdev=3647.48 00:19:22.250 lat (usec): min=51, max=120, avg=60.26, stdev= 3.78 00:19:22.250 clat percentiles (nsec): 00:19:22.250 | 1.00th=[44800], 5.00th=[45824], 10.00th=[46848], 20.00th=[48384], 00:19:22.250 | 30.00th=[49408], 40.00th=[50432], 50.00th=[51456], 60.00th=[52480], 00:19:22.250 | 70.00th=[53504], 80.00th=[54528], 90.00th=[56576], 95.00th=[57600], 00:19:22.250 | 99.00th=[60160], 99.50th=[61696], 99.90th=[64256], 99.95th=[65280], 00:19:22.250 | 99.99th=[70144] 00:19:22.250 bw ( KiB/s): min=32768, max=32768, per=100.00%, avg=32768.00, stdev= 0.00, samples=1 00:19:22.250 iops : min= 8192, max= 8192, avg=8192.00, stdev= 0.00, samples=1 00:19:22.250 lat (usec) : 50=26.63%, 100=73.37%, 250=0.01% 00:19:22.250 cpu : usr=6.10%, sys=13.80%, ctx=16041, majf=0, minf=2 00:19:22.250 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.250 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.250 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.250 issued rwts: total=7849,8192,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.250 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.250 00:19:22.250 Run status group 0 (all jobs): 00:19:22.250 READ: bw=30.6MiB/s (32.1MB/s), 30.6MiB/s-30.6MiB/s (32.1MB/s-32.1MB/s), io=30.7MiB (32.1MB), run=1001-1001msec 00:19:22.250 WRITE: bw=32.0MiB/s (33.5MB/s), 32.0MiB/s-32.0MiB/s (33.5MB/s-33.5MB/s), io=32.0MiB (33.6MB), run=1001-1001msec 00:19:22.250 00:19:22.250 Disk stats (read/write): 00:19:22.250 nvme0n1: ios=7218/7242, merge=0/0, ticks=369/338, in_queue=707, util=90.68% 00:19:22.250 00:53:29 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:24.159 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:24.159 00:53:31 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:24.159 00:53:31 -- common/autotest_common.sh@1205 -- # local i=0 00:19:24.159 00:53:31 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:24.159 00:53:31 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:24.159 00:53:31 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:24.159 00:53:31 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:24.159 00:53:31 -- common/autotest_common.sh@1217 -- # return 0 00:19:24.159 00:53:31 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:24.159 00:53:31 -- target/nmic.sh@53 -- # nvmftestfini 00:19:24.159 00:53:31 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:24.159 00:53:31 -- nvmf/common.sh@117 -- # sync 00:19:24.159 00:53:31 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:24.159 00:53:31 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:24.159 00:53:31 -- nvmf/common.sh@120 -- # set +e 00:19:24.159 00:53:31 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:24.159 00:53:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:24.159 rmmod nvme_rdma 00:19:24.159 rmmod nvme_fabrics 00:19:24.159 00:53:31 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:24.159 00:53:31 -- nvmf/common.sh@124 -- # set -e 00:19:24.159 00:53:31 -- nvmf/common.sh@125 -- # return 0 00:19:24.159 00:53:31 -- nvmf/common.sh@478 -- # '[' -n 334168 ']' 00:19:24.159 00:53:31 -- nvmf/common.sh@479 -- # killprocess 334168 00:19:24.159 00:53:31 -- common/autotest_common.sh@936 -- # '[' -z 334168 ']' 00:19:24.159 00:53:31 -- common/autotest_common.sh@940 -- # kill -0 334168 00:19:24.159 00:53:31 -- common/autotest_common.sh@941 -- # uname 00:19:24.159 00:53:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:24.159 00:53:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 334168 00:19:24.159 00:53:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:24.159 00:53:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:24.159 00:53:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 334168' 00:19:24.159 killing process with pid 334168 00:19:24.159 00:53:31 -- common/autotest_common.sh@955 -- # kill 334168 00:19:24.159 00:53:31 -- common/autotest_common.sh@960 -- # wait 334168 00:19:24.159 [2024-04-26 00:53:31.210509] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:24.420 00:53:31 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:24.420 00:53:31 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:24.420 00:19:24.420 real 0m14.205s 00:19:24.420 user 0m43.736s 00:19:24.420 sys 0m4.916s 00:19:24.420 00:53:31 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:24.420 00:53:31 -- common/autotest_common.sh@10 -- # set +x 00:19:24.420 ************************************ 00:19:24.420 END TEST nvmf_nmic 00:19:24.420 ************************************ 00:19:24.420 00:53:31 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:24.420 00:53:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:24.420 00:53:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:24.420 00:53:31 -- common/autotest_common.sh@10 -- # set +x 00:19:24.420 ************************************ 00:19:24.420 START TEST nvmf_fio_target 00:19:24.420 ************************************ 00:19:24.420 00:53:31 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:19:24.680 * Looking for test storage... 00:19:24.680 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:24.680 00:53:31 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:24.680 00:53:31 -- nvmf/common.sh@7 -- # uname -s 00:19:24.680 00:53:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:24.680 00:53:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:24.680 00:53:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:24.680 00:53:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:24.680 00:53:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:24.680 00:53:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:24.680 00:53:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:24.680 00:53:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:24.680 00:53:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:24.680 00:53:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:24.680 00:53:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:24.680 00:53:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:24.680 00:53:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:24.680 00:53:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:24.680 00:53:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:24.680 00:53:31 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:24.680 00:53:31 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:24.680 00:53:31 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:24.680 00:53:31 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:24.680 00:53:31 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:24.680 00:53:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:24.680 00:53:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:24.681 00:53:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:24.681 00:53:31 -- paths/export.sh@5 -- # export PATH 00:19:24.681 00:53:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:24.681 00:53:31 -- nvmf/common.sh@47 -- # : 0 00:19:24.681 00:53:31 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:24.681 00:53:31 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:24.681 00:53:31 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:24.681 00:53:31 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:24.681 00:53:31 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:24.681 00:53:31 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:24.681 00:53:31 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:24.681 00:53:31 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:24.681 00:53:31 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:24.681 00:53:31 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:24.681 00:53:31 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:19:24.681 00:53:31 -- target/fio.sh@16 -- # nvmftestinit 00:19:24.681 00:53:31 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:24.681 00:53:31 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:24.681 00:53:31 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:24.681 00:53:31 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:24.681 00:53:31 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:24.681 00:53:31 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:24.681 00:53:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:24.681 00:53:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:24.681 00:53:31 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:24.681 00:53:31 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:24.681 00:53:31 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:24.681 00:53:31 -- common/autotest_common.sh@10 -- # set +x 00:19:29.957 00:53:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:29.957 00:53:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:29.957 00:53:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:29.957 00:53:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:29.957 00:53:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:29.957 00:53:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:29.957 00:53:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:29.957 00:53:36 -- nvmf/common.sh@295 -- # net_devs=() 00:19:29.957 00:53:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:29.957 00:53:36 -- nvmf/common.sh@296 -- # e810=() 00:19:29.957 00:53:36 -- nvmf/common.sh@296 -- # local -ga e810 00:19:29.957 00:53:36 -- nvmf/common.sh@297 -- # x722=() 00:19:29.957 00:53:36 -- nvmf/common.sh@297 -- # local -ga x722 00:19:29.957 00:53:36 -- nvmf/common.sh@298 -- # mlx=() 00:19:29.957 00:53:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:29.957 00:53:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:29.957 00:53:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:29.957 00:53:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:29.957 00:53:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:29.957 00:53:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:29.957 00:53:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:29.957 00:53:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:29.957 00:53:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:29.957 00:53:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:29.957 00:53:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:29.957 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:29.957 00:53:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:29.957 00:53:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:29.957 00:53:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:29.958 00:53:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:29.958 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:29.958 00:53:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:29.958 00:53:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.958 00:53:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.958 00:53:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:29.958 Found net devices under 0000:18:00.0: mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.958 00:53:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.958 00:53:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.958 00:53:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:29.958 Found net devices under 0000:18:00.1: mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.958 00:53:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:29.958 00:53:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:29.958 00:53:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:29.958 00:53:36 -- nvmf/common.sh@58 -- # uname 00:19:29.958 00:53:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:29.958 00:53:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:29.958 00:53:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:29.958 00:53:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:29.958 00:53:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:29.958 00:53:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:29.958 00:53:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:29.958 00:53:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:29.958 00:53:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:29.958 00:53:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:29.958 00:53:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:29.958 00:53:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:29.958 00:53:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:29.958 00:53:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:29.958 00:53:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:29.958 00:53:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@105 -- # continue 2 00:19:29.958 00:53:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@105 -- # continue 2 00:19:29.958 00:53:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:29.958 00:53:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:29.958 00:53:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:29.958 00:53:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:29.958 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:29.958 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:29.958 altname enp24s0f0np0 00:19:29.958 altname ens785f0np0 00:19:29.958 inet 192.168.100.8/24 scope global mlx_0_0 00:19:29.958 valid_lft forever preferred_lft forever 00:19:29.958 00:53:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:29.958 00:53:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:29.958 00:53:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:29.958 00:53:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:29.958 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:29.958 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:29.958 altname enp24s0f1np1 00:19:29.958 altname ens785f1np1 00:19:29.958 inet 192.168.100.9/24 scope global mlx_0_1 00:19:29.958 valid_lft forever preferred_lft forever 00:19:29.958 00:53:36 -- nvmf/common.sh@411 -- # return 0 00:19:29.958 00:53:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:29.958 00:53:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:29.958 00:53:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:29.958 00:53:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:29.958 00:53:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:29.958 00:53:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:29.958 00:53:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:29.958 00:53:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:29.958 00:53:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:29.958 00:53:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@105 -- # continue 2 00:19:29.958 00:53:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:29.958 00:53:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:29.958 00:53:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@105 -- # continue 2 00:19:29.958 00:53:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:29.958 00:53:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:29.958 00:53:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:29.958 00:53:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:29.958 00:53:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:29.958 00:53:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:29.958 192.168.100.9' 00:19:29.958 00:53:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:29.958 192.168.100.9' 00:19:29.958 00:53:36 -- nvmf/common.sh@446 -- # head -n 1 00:19:29.958 00:53:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:29.958 00:53:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:29.958 192.168.100.9' 00:19:29.958 00:53:36 -- nvmf/common.sh@447 -- # tail -n +2 00:19:29.958 00:53:36 -- nvmf/common.sh@447 -- # head -n 1 00:19:29.958 00:53:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:29.958 00:53:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:29.958 00:53:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:29.958 00:53:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:29.958 00:53:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:29.958 00:53:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:29.958 00:53:36 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:29.958 00:53:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:29.958 00:53:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:29.958 00:53:36 -- common/autotest_common.sh@10 -- # set +x 00:19:29.958 00:53:36 -- nvmf/common.sh@470 -- # nvmfpid=339012 00:19:29.958 00:53:36 -- nvmf/common.sh@471 -- # waitforlisten 339012 00:19:29.958 00:53:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:29.958 00:53:36 -- common/autotest_common.sh@817 -- # '[' -z 339012 ']' 00:19:29.958 00:53:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:29.958 00:53:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:29.958 00:53:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:29.958 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:29.958 00:53:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:29.958 00:53:36 -- common/autotest_common.sh@10 -- # set +x 00:19:29.958 [2024-04-26 00:53:37.027163] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:19:29.959 [2024-04-26 00:53:37.027212] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:29.959 EAL: No free 2048 kB hugepages reported on node 1 00:19:29.959 [2024-04-26 00:53:37.078979] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:30.218 [2024-04-26 00:53:37.153497] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:30.218 [2024-04-26 00:53:37.153532] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:30.218 [2024-04-26 00:53:37.153538] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:30.218 [2024-04-26 00:53:37.153544] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:30.218 [2024-04-26 00:53:37.153549] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:30.218 [2024-04-26 00:53:37.153594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:30.218 [2024-04-26 00:53:37.153677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:30.218 [2024-04-26 00:53:37.153764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:30.218 [2024-04-26 00:53:37.153765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:30.787 00:53:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:30.787 00:53:37 -- common/autotest_common.sh@850 -- # return 0 00:19:30.787 00:53:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:30.787 00:53:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:30.787 00:53:37 -- common/autotest_common.sh@10 -- # set +x 00:19:30.787 00:53:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:30.787 00:53:37 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:31.048 [2024-04-26 00:53:38.004349] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x7d3880/0x7d7d70) succeed. 00:19:31.048 [2024-04-26 00:53:38.013703] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x7d4ec0/0x819400) succeed. 00:19:31.048 00:53:38 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.308 00:53:38 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:31.308 00:53:38 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.567 00:53:38 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:31.567 00:53:38 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.567 00:53:38 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:31.567 00:53:38 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:31.827 00:53:38 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:31.827 00:53:38 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:32.086 00:53:39 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:32.086 00:53:39 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:32.086 00:53:39 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:32.346 00:53:39 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:32.346 00:53:39 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:32.605 00:53:39 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:32.605 00:53:39 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:32.605 00:53:39 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:32.864 00:53:39 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:32.864 00:53:39 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:33.124 00:53:40 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:33.124 00:53:40 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:33.124 00:53:40 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:33.384 [2024-04-26 00:53:40.420114] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:33.384 00:53:40 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:33.643 00:53:40 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:33.643 00:53:40 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:19:34.582 00:53:41 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:34.582 00:53:41 -- common/autotest_common.sh@1184 -- # local i=0 00:19:34.582 00:53:41 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:19:34.582 00:53:41 -- common/autotest_common.sh@1186 -- # [[ -n 4 ]] 00:19:34.582 00:53:41 -- common/autotest_common.sh@1187 -- # nvme_device_counter=4 00:19:34.582 00:53:41 -- common/autotest_common.sh@1191 -- # sleep 2 00:19:37.119 00:53:43 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:19:37.120 00:53:43 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:19:37.120 00:53:43 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:19:37.120 00:53:43 -- common/autotest_common.sh@1193 -- # nvme_devices=4 00:19:37.120 00:53:43 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:19:37.120 00:53:43 -- common/autotest_common.sh@1194 -- # return 0 00:19:37.120 00:53:43 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:37.120 [global] 00:19:37.120 thread=1 00:19:37.120 invalidate=1 00:19:37.120 rw=write 00:19:37.120 time_based=1 00:19:37.120 runtime=1 00:19:37.120 ioengine=libaio 00:19:37.120 direct=1 00:19:37.120 bs=4096 00:19:37.120 iodepth=1 00:19:37.120 norandommap=0 00:19:37.120 numjobs=1 00:19:37.120 00:19:37.120 verify_dump=1 00:19:37.120 verify_backlog=512 00:19:37.120 verify_state_save=0 00:19:37.120 do_verify=1 00:19:37.120 verify=crc32c-intel 00:19:37.120 [job0] 00:19:37.120 filename=/dev/nvme0n1 00:19:37.120 [job1] 00:19:37.120 filename=/dev/nvme0n2 00:19:37.120 [job2] 00:19:37.120 filename=/dev/nvme0n3 00:19:37.120 [job3] 00:19:37.120 filename=/dev/nvme0n4 00:19:37.120 Could not set queue depth (nvme0n1) 00:19:37.120 Could not set queue depth (nvme0n2) 00:19:37.120 Could not set queue depth (nvme0n3) 00:19:37.120 Could not set queue depth (nvme0n4) 00:19:37.120 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.120 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.120 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.120 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.120 fio-3.35 00:19:37.120 Starting 4 threads 00:19:38.500 00:19:38.500 job0: (groupid=0, jobs=1): err= 0: pid=340502: Fri Apr 26 00:53:45 2024 00:19:38.500 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:38.500 slat (nsec): min=5471, max=26552, avg=6848.11, stdev=805.07 00:19:38.500 clat (usec): min=61, max=167, avg=94.40, stdev=20.65 00:19:38.500 lat (usec): min=68, max=173, avg=101.24, stdev=20.67 00:19:38.500 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 67], 5.00th=[ 70], 10.00th=[ 72], 20.00th=[ 74], 00:19:38.501 | 30.00th=[ 76], 40.00th=[ 79], 50.00th=[ 99], 60.00th=[ 109], 00:19:38.501 | 70.00th=[ 113], 80.00th=[ 116], 90.00th=[ 120], 95.00th=[ 124], 00:19:38.501 | 99.00th=[ 133], 99.50th=[ 137], 99.90th=[ 157], 99.95th=[ 161], 00:19:38.501 | 99.99th=[ 167] 00:19:38.501 write: IOPS=4966, BW=19.4MiB/s (20.3MB/s)(19.4MiB/1001msec); 0 zone resets 00:19:38.501 slat (nsec): min=6434, max=42876, avg=9036.74, stdev=1097.60 00:19:38.501 clat (usec): min=57, max=156, avg=94.48, stdev=20.50 00:19:38.501 lat (usec): min=64, max=169, avg=103.52, stdev=20.65 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 63], 5.00th=[ 67], 10.00th=[ 69], 20.00th=[ 72], 00:19:38.501 | 30.00th=[ 74], 40.00th=[ 81], 50.00th=[ 105], 60.00th=[ 109], 00:19:38.501 | 70.00th=[ 111], 80.00th=[ 114], 90.00th=[ 117], 95.00th=[ 120], 00:19:38.501 | 99.00th=[ 127], 99.50th=[ 135], 99.90th=[ 153], 99.95th=[ 155], 00:19:38.501 | 99.99th=[ 157] 00:19:38.501 bw ( KiB/s): min=22315, max=22315, per=32.39%, avg=22315.00, stdev= 0.00, samples=1 00:19:38.501 iops : min= 5578, max= 5578, avg=5578.00, stdev= 0.00, samples=1 00:19:38.501 lat (usec) : 100=46.72%, 250=53.28% 00:19:38.501 cpu : usr=5.30%, sys=7.00%, ctx=9579, majf=0, minf=1 00:19:38.501 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 issued rwts: total=4608,4971,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.501 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.501 job1: (groupid=0, jobs=1): err= 0: pid=340503: Fri Apr 26 00:53:45 2024 00:19:38.501 read: IOPS=3646, BW=14.2MiB/s (14.9MB/s)(14.3MiB/1001msec) 00:19:38.501 slat (nsec): min=6254, max=24553, avg=7208.60, stdev=804.65 00:19:38.501 clat (usec): min=66, max=204, avg=121.59, stdev=15.65 00:19:38.501 lat (usec): min=74, max=212, avg=128.80, stdev=15.83 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 89], 5.00th=[ 106], 10.00th=[ 109], 20.00th=[ 112], 00:19:38.501 | 30.00th=[ 114], 40.00th=[ 115], 50.00th=[ 117], 60.00th=[ 120], 00:19:38.501 | 70.00th=[ 124], 80.00th=[ 137], 90.00th=[ 145], 95.00th=[ 151], 00:19:38.501 | 99.00th=[ 172], 99.50th=[ 186], 99.90th=[ 200], 99.95th=[ 202], 00:19:38.501 | 99.99th=[ 206] 00:19:38.501 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:38.501 slat (nsec): min=6530, max=50909, avg=9278.15, stdev=1164.90 00:19:38.501 clat (usec): min=60, max=298, avg=116.39, stdev=18.14 00:19:38.501 lat (usec): min=70, max=308, avg=125.67, stdev=18.23 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 75], 5.00th=[ 96], 10.00th=[ 100], 20.00th=[ 104], 00:19:38.501 | 30.00th=[ 106], 40.00th=[ 109], 50.00th=[ 111], 60.00th=[ 115], 00:19:38.501 | 70.00th=[ 126], 80.00th=[ 133], 90.00th=[ 141], 95.00th=[ 149], 00:19:38.501 | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 196], 99.95th=[ 198], 00:19:38.501 | 99.99th=[ 297] 00:19:38.501 bw ( KiB/s): min=16384, max=16384, per=23.78%, avg=16384.00, stdev= 0.00, samples=1 00:19:38.501 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:38.501 lat (usec) : 100=5.80%, 250=94.19%, 500=0.01% 00:19:38.501 cpu : usr=4.10%, sys=6.00%, ctx=7747, majf=0, minf=1 00:19:38.501 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 issued rwts: total=3650,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.501 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.501 job2: (groupid=0, jobs=1): err= 0: pid=340504: Fri Apr 26 00:53:45 2024 00:19:38.501 read: IOPS=3580, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1001msec) 00:19:38.501 slat (nsec): min=6345, max=28024, avg=7240.90, stdev=1013.98 00:19:38.501 clat (usec): min=75, max=247, avg=122.22, stdev=16.34 00:19:38.501 lat (usec): min=83, max=255, avg=129.46, stdev=16.62 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 92], 5.00th=[ 105], 10.00th=[ 108], 20.00th=[ 111], 00:19:38.501 | 30.00th=[ 114], 40.00th=[ 116], 50.00th=[ 118], 60.00th=[ 121], 00:19:38.501 | 70.00th=[ 126], 80.00th=[ 139], 90.00th=[ 145], 95.00th=[ 151], 00:19:38.501 | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 200], 99.95th=[ 212], 00:19:38.501 | 99.99th=[ 249] 00:19:38.501 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(15.9MiB/1001msec); 0 zone resets 00:19:38.501 slat (nsec): min=8310, max=48908, avg=9579.60, stdev=1441.86 00:19:38.501 clat (usec): min=68, max=226, avg=118.05, stdev=16.92 00:19:38.501 lat (usec): min=78, max=235, avg=127.63, stdev=17.17 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 82], 5.00th=[ 100], 10.00th=[ 103], 20.00th=[ 106], 00:19:38.501 | 30.00th=[ 109], 40.00th=[ 111], 50.00th=[ 113], 60.00th=[ 117], 00:19:38.501 | 70.00th=[ 126], 80.00th=[ 133], 90.00th=[ 141], 95.00th=[ 147], 00:19:38.501 | 99.00th=[ 176], 99.50th=[ 182], 99.90th=[ 192], 99.95th=[ 196], 00:19:38.501 | 99.99th=[ 227] 00:19:38.501 bw ( KiB/s): min=16351, max=16351, per=23.73%, avg=16351.00, stdev= 0.00, samples=1 00:19:38.501 iops : min= 4087, max= 4087, avg=4087.00, stdev= 0.00, samples=1 00:19:38.501 lat (usec) : 100=3.26%, 250=96.74% 00:19:38.501 cpu : usr=3.80%, sys=6.40%, ctx=7664, majf=0, minf=1 00:19:38.501 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 issued rwts: total=3584,4080,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.501 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.501 job3: (groupid=0, jobs=1): err= 0: pid=340505: Fri Apr 26 00:53:45 2024 00:19:38.501 read: IOPS=3639, BW=14.2MiB/s (14.9MB/s)(14.2MiB/1001msec) 00:19:38.501 slat (nsec): min=6249, max=24378, avg=7236.81, stdev=831.27 00:19:38.501 clat (usec): min=70, max=203, avg=121.58, stdev=15.32 00:19:38.501 lat (usec): min=77, max=212, avg=128.82, stdev=15.45 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 93], 5.00th=[ 106], 10.00th=[ 109], 20.00th=[ 112], 00:19:38.501 | 30.00th=[ 114], 40.00th=[ 115], 50.00th=[ 117], 60.00th=[ 120], 00:19:38.501 | 70.00th=[ 124], 80.00th=[ 137], 90.00th=[ 145], 95.00th=[ 149], 00:19:38.501 | 99.00th=[ 172], 99.50th=[ 184], 99.90th=[ 198], 99.95th=[ 200], 00:19:38.501 | 99.99th=[ 204] 00:19:38.501 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:38.501 slat (nsec): min=8360, max=42415, avg=9470.61, stdev=1008.62 00:19:38.501 clat (usec): min=68, max=296, avg=116.24, stdev=17.61 00:19:38.501 lat (usec): min=78, max=305, avg=125.71, stdev=17.73 00:19:38.501 clat percentiles (usec): 00:19:38.501 | 1.00th=[ 81], 5.00th=[ 97], 10.00th=[ 100], 20.00th=[ 104], 00:19:38.501 | 30.00th=[ 106], 40.00th=[ 109], 50.00th=[ 111], 60.00th=[ 115], 00:19:38.501 | 70.00th=[ 126], 80.00th=[ 133], 90.00th=[ 141], 95.00th=[ 147], 00:19:38.501 | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 188], 99.95th=[ 192], 00:19:38.501 | 99.99th=[ 297] 00:19:38.501 bw ( KiB/s): min=16384, max=16384, per=23.78%, avg=16384.00, stdev= 0.00, samples=1 00:19:38.501 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:38.501 lat (usec) : 100=5.84%, 250=94.15%, 500=0.01% 00:19:38.501 cpu : usr=3.30%, sys=7.20%, ctx=7739, majf=0, minf=2 00:19:38.501 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.501 issued rwts: total=3643,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.501 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.501 00:19:38.501 Run status group 0 (all jobs): 00:19:38.501 READ: bw=60.4MiB/s (63.4MB/s), 14.0MiB/s-18.0MiB/s (14.7MB/s-18.9MB/s), io=60.5MiB (63.4MB), run=1001-1001msec 00:19:38.501 WRITE: bw=67.3MiB/s (70.6MB/s), 15.9MiB/s-19.4MiB/s (16.7MB/s-20.3MB/s), io=67.4MiB (70.6MB), run=1001-1001msec 00:19:38.501 00:19:38.501 Disk stats (read/write): 00:19:38.501 nvme0n1: ios=4146/4204, merge=0/0, ticks=393/366, in_queue=759, util=87.37% 00:19:38.501 nvme0n2: ios=3077/3583, merge=0/0, ticks=364/410, in_queue=774, util=87.42% 00:19:38.501 nvme0n3: ios=3072/3501, merge=0/0, ticks=365/388, in_queue=753, util=89.23% 00:19:38.501 nvme0n4: ios=3072/3577, merge=0/0, ticks=349/404, in_queue=753, util=89.70% 00:19:38.501 00:53:45 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:38.501 [global] 00:19:38.501 thread=1 00:19:38.501 invalidate=1 00:19:38.501 rw=randwrite 00:19:38.501 time_based=1 00:19:38.501 runtime=1 00:19:38.501 ioengine=libaio 00:19:38.501 direct=1 00:19:38.501 bs=4096 00:19:38.501 iodepth=1 00:19:38.501 norandommap=0 00:19:38.501 numjobs=1 00:19:38.501 00:19:38.501 verify_dump=1 00:19:38.501 verify_backlog=512 00:19:38.501 verify_state_save=0 00:19:38.501 do_verify=1 00:19:38.501 verify=crc32c-intel 00:19:38.501 [job0] 00:19:38.501 filename=/dev/nvme0n1 00:19:38.501 [job1] 00:19:38.501 filename=/dev/nvme0n2 00:19:38.501 [job2] 00:19:38.501 filename=/dev/nvme0n3 00:19:38.501 [job3] 00:19:38.501 filename=/dev/nvme0n4 00:19:38.501 Could not set queue depth (nvme0n1) 00:19:38.501 Could not set queue depth (nvme0n2) 00:19:38.501 Could not set queue depth (nvme0n3) 00:19:38.501 Could not set queue depth (nvme0n4) 00:19:38.501 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:38.501 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:38.501 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:38.501 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:38.501 fio-3.35 00:19:38.501 Starting 4 threads 00:19:39.884 00:19:39.884 job0: (groupid=0, jobs=1): err= 0: pid=340930: Fri Apr 26 00:53:46 2024 00:19:39.884 read: IOPS=4122, BW=16.1MiB/s (16.9MB/s)(16.1MiB/1001msec) 00:19:39.884 slat (nsec): min=6127, max=27248, avg=6980.45, stdev=826.71 00:19:39.884 clat (usec): min=67, max=349, avg=108.57, stdev=19.20 00:19:39.884 lat (usec): min=74, max=356, avg=115.55, stdev=19.20 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 86], 5.00th=[ 93], 10.00th=[ 96], 20.00th=[ 100], 00:19:39.884 | 30.00th=[ 102], 40.00th=[ 105], 50.00th=[ 108], 60.00th=[ 110], 00:19:39.884 | 70.00th=[ 112], 80.00th=[ 115], 90.00th=[ 119], 95.00th=[ 123], 00:19:39.884 | 99.00th=[ 215], 99.50th=[ 255], 99.90th=[ 318], 99.95th=[ 330], 00:19:39.884 | 99.99th=[ 351] 00:19:39.884 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:39.884 slat (nsec): min=6602, max=69052, avg=8742.26, stdev=1207.60 00:19:39.884 clat (usec): min=61, max=410, avg=101.11, stdev=17.07 00:19:39.884 lat (usec): min=70, max=419, avg=109.85, stdev=17.11 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 78], 5.00th=[ 86], 10.00th=[ 90], 20.00th=[ 93], 00:19:39.884 | 30.00th=[ 95], 40.00th=[ 98], 50.00th=[ 100], 60.00th=[ 102], 00:19:39.884 | 70.00th=[ 104], 80.00th=[ 106], 90.00th=[ 111], 95.00th=[ 117], 00:19:39.884 | 99.00th=[ 172], 99.50th=[ 227], 99.90th=[ 281], 99.95th=[ 314], 00:19:39.884 | 99.99th=[ 412] 00:19:39.884 bw ( KiB/s): min=18184, max=18184, per=24.56%, avg=18184.00, stdev= 0.00, samples=1 00:19:39.884 iops : min= 4546, max= 4546, avg=4546.00, stdev= 0.00, samples=1 00:19:39.884 lat (usec) : 100=38.16%, 250=61.45%, 500=0.39% 00:19:39.884 cpu : usr=3.50%, sys=7.50%, ctx=8736, majf=0, minf=1 00:19:39.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:39.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 issued rwts: total=4127,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:39.884 job1: (groupid=0, jobs=1): err= 0: pid=340931: Fri Apr 26 00:53:46 2024 00:19:39.884 read: IOPS=4122, BW=16.1MiB/s (16.9MB/s)(16.1MiB/1001msec) 00:19:39.884 slat (nsec): min=6134, max=17138, avg=6985.31, stdev=757.29 00:19:39.884 clat (usec): min=68, max=357, avg=108.71, stdev=18.05 00:19:39.884 lat (usec): min=75, max=364, avg=115.70, stdev=18.06 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 88], 5.00th=[ 93], 10.00th=[ 96], 20.00th=[ 100], 00:19:39.884 | 30.00th=[ 103], 40.00th=[ 105], 50.00th=[ 108], 60.00th=[ 110], 00:19:39.884 | 70.00th=[ 112], 80.00th=[ 115], 90.00th=[ 119], 95.00th=[ 124], 00:19:39.884 | 99.00th=[ 204], 99.50th=[ 249], 99.90th=[ 302], 99.95th=[ 306], 00:19:39.884 | 99.99th=[ 359] 00:19:39.884 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:39.884 slat (nsec): min=7674, max=41329, avg=8769.86, stdev=1043.07 00:19:39.884 clat (usec): min=60, max=409, avg=101.00, stdev=17.03 00:19:39.884 lat (usec): min=68, max=420, avg=109.77, stdev=17.05 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 79], 5.00th=[ 87], 10.00th=[ 89], 20.00th=[ 93], 00:19:39.884 | 30.00th=[ 95], 40.00th=[ 98], 50.00th=[ 99], 60.00th=[ 102], 00:19:39.884 | 70.00th=[ 104], 80.00th=[ 106], 90.00th=[ 111], 95.00th=[ 116], 00:19:39.884 | 99.00th=[ 184], 99.50th=[ 231], 99.90th=[ 269], 99.95th=[ 314], 00:19:39.884 | 99.99th=[ 408] 00:19:39.884 bw ( KiB/s): min=18232, max=18232, per=24.63%, avg=18232.00, stdev= 0.00, samples=1 00:19:39.884 iops : min= 4558, max= 4558, avg=4558.00, stdev= 0.00, samples=1 00:19:39.884 lat (usec) : 100=38.35%, 250=61.29%, 500=0.35% 00:19:39.884 cpu : usr=4.10%, sys=6.80%, ctx=8735, majf=0, minf=1 00:19:39.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:39.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 issued rwts: total=4127,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:39.884 job2: (groupid=0, jobs=1): err= 0: pid=340932: Fri Apr 26 00:53:46 2024 00:19:39.884 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:19:39.884 slat (nsec): min=6144, max=26919, avg=7074.70, stdev=760.90 00:19:39.884 clat (usec): min=69, max=344, avg=108.01, stdev=20.38 00:19:39.884 lat (usec): min=77, max=350, avg=115.08, stdev=20.47 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 83], 5.00th=[ 86], 10.00th=[ 89], 20.00th=[ 93], 00:19:39.884 | 30.00th=[ 95], 40.00th=[ 98], 50.00th=[ 101], 60.00th=[ 106], 00:19:39.884 | 70.00th=[ 116], 80.00th=[ 125], 90.00th=[ 135], 95.00th=[ 155], 00:19:39.884 | 99.00th=[ 172], 99.50th=[ 174], 99.90th=[ 180], 99.95th=[ 182], 00:19:39.884 | 99.99th=[ 347] 00:19:39.884 write: IOPS=4551, BW=17.8MiB/s (18.6MB/s)(17.8MiB/1001msec); 0 zone resets 00:19:39.884 slat (nsec): min=7868, max=39157, avg=9039.54, stdev=1122.23 00:19:39.884 clat (usec): min=65, max=181, avg=103.18, stdev=20.54 00:19:39.884 lat (usec): min=74, max=192, avg=112.22, stdev=20.74 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 79], 5.00th=[ 82], 10.00th=[ 84], 20.00th=[ 87], 00:19:39.884 | 30.00th=[ 90], 40.00th=[ 93], 50.00th=[ 96], 60.00th=[ 100], 00:19:39.884 | 70.00th=[ 112], 80.00th=[ 121], 90.00th=[ 130], 95.00th=[ 153], 00:19:39.884 | 99.00th=[ 165], 99.50th=[ 167], 99.90th=[ 176], 99.95th=[ 176], 00:19:39.884 | 99.99th=[ 182] 00:19:39.884 bw ( KiB/s): min=20480, max=20480, per=27.67%, avg=20480.00, stdev= 0.00, samples=1 00:19:39.884 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:39.884 lat (usec) : 100=53.83%, 250=46.16%, 500=0.01% 00:19:39.884 cpu : usr=4.80%, sys=6.60%, ctx=8652, majf=0, minf=1 00:19:39.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:39.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 issued rwts: total=4096,4556,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:39.884 job3: (groupid=0, jobs=1): err= 0: pid=340935: Fri Apr 26 00:53:46 2024 00:19:39.884 read: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec) 00:19:39.884 slat (nsec): min=6102, max=44143, avg=7011.43, stdev=1094.15 00:19:39.884 clat (usec): min=66, max=193, avg=98.78, stdev=23.60 00:19:39.884 lat (usec): min=73, max=200, avg=105.80, stdev=23.79 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 75], 5.00th=[ 78], 10.00th=[ 80], 20.00th=[ 82], 00:19:39.884 | 30.00th=[ 84], 40.00th=[ 86], 50.00th=[ 88], 60.00th=[ 91], 00:19:39.884 | 70.00th=[ 101], 80.00th=[ 124], 90.00th=[ 133], 95.00th=[ 145], 00:19:39.884 | 99.00th=[ 172], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 184], 00:19:39.884 | 99.99th=[ 194] 00:19:39.884 write: IOPS=4748, BW=18.5MiB/s (19.4MB/s)(18.6MiB/1001msec); 0 zone resets 00:19:39.884 slat (nsec): min=7863, max=35212, avg=8968.53, stdev=995.86 00:19:39.884 clat (usec): min=67, max=177, avg=94.88, stdev=23.43 00:19:39.884 lat (usec): min=75, max=187, avg=103.85, stdev=23.68 00:19:39.884 clat percentiles (usec): 00:19:39.884 | 1.00th=[ 72], 5.00th=[ 75], 10.00th=[ 76], 20.00th=[ 78], 00:19:39.884 | 30.00th=[ 80], 40.00th=[ 82], 50.00th=[ 84], 60.00th=[ 87], 00:19:39.884 | 70.00th=[ 98], 80.00th=[ 120], 90.00th=[ 128], 95.00th=[ 149], 00:19:39.884 | 99.00th=[ 163], 99.50th=[ 167], 99.90th=[ 176], 99.95th=[ 178], 00:19:39.884 | 99.99th=[ 178] 00:19:39.884 bw ( KiB/s): min=22792, max=22792, per=30.79%, avg=22792.00, stdev= 0.00, samples=1 00:19:39.884 iops : min= 5698, max= 5698, avg=5698.00, stdev= 0.00, samples=1 00:19:39.884 lat (usec) : 100=70.15%, 250=29.85% 00:19:39.884 cpu : usr=4.50%, sys=7.50%, ctx=9362, majf=0, minf=2 00:19:39.884 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:39.884 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.884 issued rwts: total=4608,4753,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.884 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:39.884 00:19:39.884 Run status group 0 (all jobs): 00:19:39.884 READ: bw=66.2MiB/s (69.4MB/s), 16.0MiB/s-18.0MiB/s (16.8MB/s-18.9MB/s), io=66.2MiB (69.5MB), run=1001-1001msec 00:19:39.884 WRITE: bw=72.3MiB/s (75.8MB/s), 17.8MiB/s-18.5MiB/s (18.6MB/s-19.4MB/s), io=72.4MiB (75.9MB), run=1001-1001msec 00:19:39.884 00:19:39.884 Disk stats (read/write): 00:19:39.884 nvme0n1: ios=3634/3947, merge=0/0, ticks=385/377, in_queue=762, util=87.68% 00:19:39.884 nvme0n2: ios=3589/3946, merge=0/0, ticks=373/375, in_queue=748, util=87.75% 00:19:39.884 nvme0n3: ios=3584/4053, merge=0/0, ticks=358/393, in_queue=751, util=89.37% 00:19:39.884 nvme0n4: ios=4096/4249, merge=0/0, ticks=368/379, in_queue=747, util=89.93% 00:19:39.884 00:53:46 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:39.884 [global] 00:19:39.884 thread=1 00:19:39.884 invalidate=1 00:19:39.884 rw=write 00:19:39.884 time_based=1 00:19:39.884 runtime=1 00:19:39.884 ioengine=libaio 00:19:39.884 direct=1 00:19:39.884 bs=4096 00:19:39.884 iodepth=128 00:19:39.884 norandommap=0 00:19:39.884 numjobs=1 00:19:39.884 00:19:39.884 verify_dump=1 00:19:39.884 verify_backlog=512 00:19:39.884 verify_state_save=0 00:19:39.884 do_verify=1 00:19:39.884 verify=crc32c-intel 00:19:39.884 [job0] 00:19:39.884 filename=/dev/nvme0n1 00:19:39.884 [job1] 00:19:39.884 filename=/dev/nvme0n2 00:19:39.884 [job2] 00:19:39.885 filename=/dev/nvme0n3 00:19:39.885 [job3] 00:19:39.885 filename=/dev/nvme0n4 00:19:39.885 Could not set queue depth (nvme0n1) 00:19:39.885 Could not set queue depth (nvme0n2) 00:19:39.885 Could not set queue depth (nvme0n3) 00:19:39.885 Could not set queue depth (nvme0n4) 00:19:40.144 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.144 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.144 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.144 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.144 fio-3.35 00:19:40.144 Starting 4 threads 00:19:41.543 00:19:41.543 job0: (groupid=0, jobs=1): err= 0: pid=341361: Fri Apr 26 00:53:48 2024 00:19:41.543 read: IOPS=7657, BW=29.9MiB/s (31.4MB/s)(30.0MiB/1003msec) 00:19:41.543 slat (nsec): min=1134, max=5430.6k, avg=63922.34, stdev=302372.26 00:19:41.543 clat (usec): min=2784, max=19044, avg=8424.15, stdev=2819.60 00:19:41.543 lat (usec): min=2855, max=20911, avg=8488.07, stdev=2834.34 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 3949], 5.00th=[ 4948], 10.00th=[ 5538], 20.00th=[ 6194], 00:19:41.543 | 30.00th=[ 6652], 40.00th=[ 6980], 50.00th=[ 7373], 60.00th=[ 8029], 00:19:41.543 | 70.00th=[ 9765], 80.00th=[11076], 90.00th=[12780], 95.00th=[13698], 00:19:41.543 | 99.00th=[16188], 99.50th=[17433], 99.90th=[18482], 99.95th=[18482], 00:19:41.543 | 99.99th=[19006] 00:19:41.543 write: IOPS=7729, BW=30.2MiB/s (31.7MB/s)(30.3MiB/1003msec); 0 zone resets 00:19:41.543 slat (nsec): min=1746, max=5531.7k, avg=63548.19, stdev=309352.48 00:19:41.543 clat (usec): min=1899, max=22532, avg=8046.51, stdev=3246.91 00:19:41.543 lat (usec): min=2548, max=24789, avg=8110.06, stdev=3264.73 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 3392], 5.00th=[ 4228], 10.00th=[ 4752], 20.00th=[ 5604], 00:19:41.543 | 30.00th=[ 6194], 40.00th=[ 6587], 50.00th=[ 7046], 60.00th=[ 8029], 00:19:41.543 | 70.00th=[ 9110], 80.00th=[10159], 90.00th=[12256], 95.00th=[14484], 00:19:41.543 | 99.00th=[19792], 99.50th=[20841], 99.90th=[21627], 99.95th=[21627], 00:19:41.543 | 99.99th=[22414] 00:19:41.543 bw ( KiB/s): min=30664, max=30776, per=28.29%, avg=30720.00, stdev=79.20, samples=2 00:19:41.543 iops : min= 7666, max= 7694, avg=7680.00, stdev=19.80, samples=2 00:19:41.543 lat (msec) : 2=0.01%, 4=2.15%, 10=72.90%, 20=24.45%, 50=0.49% 00:19:41.543 cpu : usr=3.19%, sys=2.79%, ctx=1719, majf=0, minf=1 00:19:41.543 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:41.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.543 issued rwts: total=7680,7753,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.543 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.543 job1: (groupid=0, jobs=1): err= 0: pid=341371: Fri Apr 26 00:53:48 2024 00:19:41.543 read: IOPS=7146, BW=27.9MiB/s (29.3MB/s)(28.0MiB/1003msec) 00:19:41.543 slat (nsec): min=1183, max=5970.5k, avg=68297.03, stdev=358073.82 00:19:41.543 clat (usec): min=868, max=24072, avg=9009.42, stdev=3524.07 00:19:41.543 lat (usec): min=884, max=25128, avg=9077.72, stdev=3541.37 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 3097], 5.00th=[ 4621], 10.00th=[ 5145], 20.00th=[ 5997], 00:19:41.543 | 30.00th=[ 6849], 40.00th=[ 7635], 50.00th=[ 8356], 60.00th=[ 9372], 00:19:41.543 | 70.00th=[10290], 80.00th=[11469], 90.00th=[14091], 95.00th=[16712], 00:19:41.543 | 99.00th=[18744], 99.50th=[20317], 99.90th=[23462], 99.95th=[23462], 00:19:41.543 | 99.99th=[23987] 00:19:41.543 write: IOPS=7167, BW=28.0MiB/s (29.4MB/s)(28.1MiB/1003msec); 0 zone resets 00:19:41.543 slat (nsec): min=1762, max=5566.5k, avg=68392.51, stdev=329435.53 00:19:41.543 clat (usec): min=2171, max=25652, avg=8664.63, stdev=3536.18 00:19:41.543 lat (usec): min=2476, max=27886, avg=8733.03, stdev=3553.36 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 3392], 5.00th=[ 4146], 10.00th=[ 4686], 20.00th=[ 5473], 00:19:41.543 | 30.00th=[ 6325], 40.00th=[ 7242], 50.00th=[ 8356], 60.00th=[ 9241], 00:19:41.543 | 70.00th=[10159], 80.00th=[11207], 90.00th=[12649], 95.00th=[14877], 00:19:41.543 | 99.00th=[21103], 99.50th=[21627], 99.90th=[25035], 99.95th=[25035], 00:19:41.543 | 99.99th=[25560] 00:19:41.543 bw ( KiB/s): min=28672, max=28672, per=26.40%, avg=28672.00, stdev= 0.00, samples=2 00:19:41.543 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=2 00:19:41.543 lat (usec) : 1000=0.04% 00:19:41.543 lat (msec) : 2=0.13%, 4=2.88%, 10=64.89%, 20=31.14%, 50=0.93% 00:19:41.543 cpu : usr=1.80%, sys=3.69%, ctx=1635, majf=0, minf=1 00:19:41.543 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:41.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.543 issued rwts: total=7168,7189,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.543 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.543 job2: (groupid=0, jobs=1): err= 0: pid=341385: Fri Apr 26 00:53:48 2024 00:19:41.543 read: IOPS=5787, BW=22.6MiB/s (23.7MB/s)(22.7MiB/1003msec) 00:19:41.543 slat (nsec): min=1190, max=7277.1k, avg=84238.24, stdev=394973.24 00:19:41.543 clat (usec): min=2061, max=22479, avg=10636.68, stdev=3784.65 00:19:41.543 lat (usec): min=2928, max=23336, avg=10720.92, stdev=3807.01 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 4686], 5.00th=[ 5997], 10.00th=[ 6718], 20.00th=[ 7570], 00:19:41.543 | 30.00th=[ 8094], 40.00th=[ 9110], 50.00th=[ 9896], 60.00th=[10683], 00:19:41.543 | 70.00th=[11863], 80.00th=[13042], 90.00th=[16581], 95.00th=[18744], 00:19:41.543 | 99.00th=[21103], 99.50th=[21890], 99.90th=[22414], 99.95th=[22414], 00:19:41.543 | 99.99th=[22414] 00:19:41.543 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:41.543 slat (nsec): min=1821, max=5199.0k, avg=80957.53, stdev=382591.72 00:19:41.543 clat (usec): min=2627, max=22479, avg=10589.30, stdev=3609.00 00:19:41.543 lat (usec): min=2629, max=22488, avg=10670.26, stdev=3624.21 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 4359], 5.00th=[ 6063], 10.00th=[ 6587], 20.00th=[ 7111], 00:19:41.543 | 30.00th=[ 7963], 40.00th=[ 8979], 50.00th=[10159], 60.00th=[10945], 00:19:41.543 | 70.00th=[12256], 80.00th=[13960], 90.00th=[15795], 95.00th=[17171], 00:19:41.543 | 99.00th=[20055], 99.50th=[21627], 99.90th=[21890], 99.95th=[21890], 00:19:41.543 | 99.99th=[22414] 00:19:41.543 bw ( KiB/s): min=24576, max=24576, per=22.63%, avg=24576.00, stdev= 0.00, samples=2 00:19:41.543 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:19:41.543 lat (msec) : 4=0.41%, 10=49.54%, 20=47.85%, 50=2.20% 00:19:41.543 cpu : usr=1.10%, sys=4.09%, ctx=1469, majf=0, minf=1 00:19:41.543 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:41.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.543 issued rwts: total=5805,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.543 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.543 job3: (groupid=0, jobs=1): err= 0: pid=341390: Fri Apr 26 00:53:48 2024 00:19:41.543 read: IOPS=5901, BW=23.1MiB/s (24.2MB/s)(23.1MiB/1003msec) 00:19:41.543 slat (nsec): min=1199, max=5951.2k, avg=79972.24, stdev=374593.71 00:19:41.543 clat (usec): min=1767, max=23888, avg=10331.84, stdev=3612.92 00:19:41.543 lat (usec): min=3374, max=23891, avg=10411.81, stdev=3629.48 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 4015], 5.00th=[ 5735], 10.00th=[ 6587], 20.00th=[ 7504], 00:19:41.543 | 30.00th=[ 8094], 40.00th=[ 8979], 50.00th=[ 9634], 60.00th=[10290], 00:19:41.543 | 70.00th=[11600], 80.00th=[12649], 90.00th=[15401], 95.00th=[17957], 00:19:41.543 | 99.00th=[21365], 99.50th=[22152], 99.90th=[22938], 99.95th=[22938], 00:19:41.543 | 99.99th=[23987] 00:19:41.543 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:41.543 slat (nsec): min=1794, max=4891.5k, avg=83601.81, stdev=356245.71 00:19:41.543 clat (usec): min=3015, max=23111, avg=10721.81, stdev=3657.14 00:19:41.543 lat (usec): min=3507, max=23113, avg=10805.41, stdev=3678.31 00:19:41.543 clat percentiles (usec): 00:19:41.543 | 1.00th=[ 4883], 5.00th=[ 5932], 10.00th=[ 6915], 20.00th=[ 7635], 00:19:41.543 | 30.00th=[ 8160], 40.00th=[ 9110], 50.00th=[10159], 60.00th=[10814], 00:19:41.543 | 70.00th=[12125], 80.00th=[13435], 90.00th=[16319], 95.00th=[17957], 00:19:41.543 | 99.00th=[21103], 99.50th=[21365], 99.90th=[21890], 99.95th=[22152], 00:19:41.543 | 99.99th=[23200] 00:19:41.543 bw ( KiB/s): min=24576, max=24576, per=22.63%, avg=24576.00, stdev= 0.00, samples=2 00:19:41.543 iops : min= 6144, max= 6144, avg=6144.00, stdev= 0.00, samples=2 00:19:41.543 lat (msec) : 2=0.01%, 4=0.50%, 10=51.63%, 20=45.72%, 50=2.15% 00:19:41.543 cpu : usr=1.70%, sys=3.39%, ctx=1531, majf=0, minf=1 00:19:41.543 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:41.543 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.543 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.543 issued rwts: total=5919,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.543 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.543 00:19:41.543 Run status group 0 (all jobs): 00:19:41.543 READ: bw=103MiB/s (109MB/s), 22.6MiB/s-29.9MiB/s (23.7MB/s-31.4MB/s), io=104MiB (109MB), run=1003-1003msec 00:19:41.543 WRITE: bw=106MiB/s (111MB/s), 23.9MiB/s-30.2MiB/s (25.1MB/s-31.7MB/s), io=106MiB (112MB), run=1003-1003msec 00:19:41.543 00:19:41.543 Disk stats (read/write): 00:19:41.543 nvme0n1: ios=6671/6656, merge=0/0, ticks=15761/15942, in_queue=31703, util=87.17% 00:19:41.543 nvme0n2: ios=6156/6413, merge=0/0, ticks=17892/17222, in_queue=35114, util=85.01% 00:19:41.543 nvme0n3: ios=5120/5530, merge=0/0, ticks=16381/17283, in_queue=33664, util=88.43% 00:19:41.543 nvme0n4: ios=4791/5120, merge=0/0, ticks=15818/17249, in_queue=33067, util=89.09% 00:19:41.543 00:53:48 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:41.544 [global] 00:19:41.544 thread=1 00:19:41.544 invalidate=1 00:19:41.544 rw=randwrite 00:19:41.544 time_based=1 00:19:41.544 runtime=1 00:19:41.544 ioengine=libaio 00:19:41.544 direct=1 00:19:41.544 bs=4096 00:19:41.544 iodepth=128 00:19:41.544 norandommap=0 00:19:41.544 numjobs=1 00:19:41.544 00:19:41.544 verify_dump=1 00:19:41.544 verify_backlog=512 00:19:41.544 verify_state_save=0 00:19:41.544 do_verify=1 00:19:41.544 verify=crc32c-intel 00:19:41.544 [job0] 00:19:41.544 filename=/dev/nvme0n1 00:19:41.544 [job1] 00:19:41.544 filename=/dev/nvme0n2 00:19:41.544 [job2] 00:19:41.544 filename=/dev/nvme0n3 00:19:41.544 [job3] 00:19:41.544 filename=/dev/nvme0n4 00:19:41.544 Could not set queue depth (nvme0n1) 00:19:41.544 Could not set queue depth (nvme0n2) 00:19:41.544 Could not set queue depth (nvme0n3) 00:19:41.544 Could not set queue depth (nvme0n4) 00:19:41.801 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:41.801 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:41.801 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:41.801 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:41.801 fio-3.35 00:19:41.801 Starting 4 threads 00:19:43.171 00:19:43.171 job0: (groupid=0, jobs=1): err= 0: pid=341835: Fri Apr 26 00:53:49 2024 00:19:43.171 read: IOPS=6636, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1003msec) 00:19:43.171 slat (nsec): min=1170, max=5319.7k, avg=76521.56, stdev=365005.12 00:19:43.171 clat (usec): min=3141, max=18112, avg=9663.88, stdev=3662.09 00:19:43.171 lat (usec): min=3157, max=18119, avg=9740.40, stdev=3682.84 00:19:43.171 clat percentiles (usec): 00:19:43.171 | 1.00th=[ 3949], 5.00th=[ 4817], 10.00th=[ 5342], 20.00th=[ 6128], 00:19:43.171 | 30.00th=[ 6849], 40.00th=[ 7963], 50.00th=[ 9110], 60.00th=[10552], 00:19:43.171 | 70.00th=[11863], 80.00th=[13173], 90.00th=[14615], 95.00th=[16450], 00:19:43.171 | 99.00th=[17695], 99.50th=[17957], 99.90th=[17957], 99.95th=[18220], 00:19:43.171 | 99.99th=[18220] 00:19:43.171 write: IOPS=6994, BW=27.3MiB/s (28.6MB/s)(27.4MiB/1003msec); 0 zone resets 00:19:43.171 slat (nsec): min=1693, max=4890.7k, avg=67114.65, stdev=306451.57 00:19:43.171 clat (usec): min=2298, max=19538, avg=8939.86, stdev=3366.53 00:19:43.171 lat (usec): min=2899, max=19570, avg=9006.98, stdev=3383.02 00:19:43.171 clat percentiles (usec): 00:19:43.171 | 1.00th=[ 3949], 5.00th=[ 4948], 10.00th=[ 5407], 20.00th=[ 6128], 00:19:43.171 | 30.00th=[ 6521], 40.00th=[ 7046], 50.00th=[ 8094], 60.00th=[ 9110], 00:19:43.171 | 70.00th=[10421], 80.00th=[11863], 90.00th=[13829], 95.00th=[15664], 00:19:43.171 | 99.00th=[18482], 99.50th=[19530], 99.90th=[19530], 99.95th=[19530], 00:19:43.171 | 99.99th=[19530] 00:19:43.171 bw ( KiB/s): min=24576, max=30528, per=25.13%, avg=27552.00, stdev=4208.70, samples=2 00:19:43.171 iops : min= 6144, max= 7632, avg=6888.00, stdev=1052.17, samples=2 00:19:43.171 lat (msec) : 4=1.47%, 10=59.56%, 20=38.97% 00:19:43.172 cpu : usr=2.89%, sys=3.69%, ctx=1394, majf=0, minf=1 00:19:43.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:43.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:43.172 issued rwts: total=6656,7015,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:43.172 job1: (groupid=0, jobs=1): err= 0: pid=341847: Fri Apr 26 00:53:49 2024 00:19:43.172 read: IOPS=7782, BW=30.4MiB/s (31.9MB/s)(30.5MiB/1002msec) 00:19:43.172 slat (nsec): min=1164, max=4232.6k, avg=61072.63, stdev=289252.02 00:19:43.172 clat (usec): min=456, max=21070, avg=7872.78, stdev=3061.66 00:19:43.172 lat (usec): min=1391, max=21072, avg=7933.85, stdev=3080.93 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 3851], 5.00th=[ 4621], 10.00th=[ 5080], 20.00th=[ 5538], 00:19:43.172 | 30.00th=[ 5932], 40.00th=[ 6390], 50.00th=[ 6849], 60.00th=[ 7635], 00:19:43.172 | 70.00th=[ 8717], 80.00th=[10028], 90.00th=[11863], 95.00th=[14877], 00:19:43.172 | 99.00th=[17433], 99.50th=[18744], 99.90th=[19006], 99.95th=[19268], 00:19:43.172 | 99.99th=[21103] 00:19:43.172 write: IOPS=8175, BW=31.9MiB/s (33.5MB/s)(32.0MiB/1002msec); 0 zone resets 00:19:43.172 slat (nsec): min=1705, max=5078.8k, avg=60841.10, stdev=270573.12 00:19:43.172 clat (usec): min=2663, max=17385, avg=7967.44, stdev=3089.73 00:19:43.172 lat (usec): min=2725, max=18528, avg=8028.28, stdev=3108.11 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 4113], 5.00th=[ 4621], 10.00th=[ 4948], 20.00th=[ 5407], 00:19:43.172 | 30.00th=[ 5997], 40.00th=[ 6390], 50.00th=[ 6915], 60.00th=[ 7570], 00:19:43.172 | 70.00th=[ 8848], 80.00th=[10290], 90.00th=[12649], 95.00th=[14877], 00:19:43.172 | 99.00th=[16909], 99.50th=[17171], 99.90th=[17171], 99.95th=[17433], 00:19:43.172 | 99.99th=[17433] 00:19:43.172 bw ( KiB/s): min=32768, max=32768, per=29.88%, avg=32768.00, stdev= 0.00, samples=1 00:19:43.172 iops : min= 8192, max= 8192, avg=8192.00, stdev= 0.00, samples=1 00:19:43.172 lat (usec) : 500=0.01% 00:19:43.172 lat (msec) : 2=0.08%, 4=0.98%, 10=77.60%, 20=21.33%, 50=0.01% 00:19:43.172 cpu : usr=3.30%, sys=5.39%, ctx=1482, majf=0, minf=1 00:19:43.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:19:43.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:43.172 issued rwts: total=7798,8192,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:43.172 job2: (groupid=0, jobs=1): err= 0: pid=341865: Fri Apr 26 00:53:49 2024 00:19:43.172 read: IOPS=5968, BW=23.3MiB/s (24.4MB/s)(23.4MiB/1003msec) 00:19:43.172 slat (nsec): min=1225, max=5531.8k, avg=80770.40, stdev=414871.08 00:19:43.172 clat (usec): min=1710, max=19795, avg=10544.83, stdev=3452.97 00:19:43.172 lat (usec): min=3395, max=20548, avg=10625.60, stdev=3470.80 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 4490], 5.00th=[ 5735], 10.00th=[ 6390], 20.00th=[ 7504], 00:19:43.172 | 30.00th=[ 8160], 40.00th=[ 8979], 50.00th=[10028], 60.00th=[11469], 00:19:43.172 | 70.00th=[12256], 80.00th=[13829], 90.00th=[15533], 95.00th=[16712], 00:19:43.172 | 99.00th=[18482], 99.50th=[18744], 99.90th=[19006], 99.95th=[19792], 00:19:43.172 | 99.99th=[19792] 00:19:43.172 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:43.172 slat (nsec): min=1687, max=4651.8k, avg=81046.24, stdev=401796.56 00:19:43.172 clat (usec): min=4129, max=21403, avg=10372.64, stdev=3412.75 00:19:43.172 lat (usec): min=4131, max=21406, avg=10453.69, stdev=3424.31 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 5342], 5.00th=[ 6128], 10.00th=[ 6587], 20.00th=[ 7308], 00:19:43.172 | 30.00th=[ 7898], 40.00th=[ 8455], 50.00th=[ 9503], 60.00th=[10683], 00:19:43.172 | 70.00th=[12387], 80.00th=[13698], 90.00th=[15533], 95.00th=[16188], 00:19:43.172 | 99.00th=[18220], 99.50th=[20055], 99.90th=[21365], 99.95th=[21365], 00:19:43.172 | 99.99th=[21365] 00:19:43.172 bw ( KiB/s): min=20480, max=28672, per=22.41%, avg=24576.00, stdev=5792.62, samples=2 00:19:43.172 iops : min= 5120, max= 7168, avg=6144.00, stdev=1448.15, samples=2 00:19:43.172 lat (msec) : 2=0.01%, 4=0.39%, 10=51.36%, 20=48.04%, 50=0.21% 00:19:43.172 cpu : usr=2.89%, sys=3.49%, ctx=1230, majf=0, minf=1 00:19:43.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:43.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:43.172 issued rwts: total=5986,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:43.172 job3: (groupid=0, jobs=1): err= 0: pid=341870: Fri Apr 26 00:53:49 2024 00:19:43.172 read: IOPS=5910, BW=23.1MiB/s (24.2MB/s)(23.2MiB/1003msec) 00:19:43.172 slat (nsec): min=1199, max=4891.3k, avg=80505.89, stdev=373445.16 00:19:43.172 clat (usec): min=2554, max=22058, avg=10404.20, stdev=3849.60 00:19:43.172 lat (usec): min=3434, max=22060, avg=10484.70, stdev=3867.64 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 4948], 5.00th=[ 5669], 10.00th=[ 6259], 20.00th=[ 7111], 00:19:43.172 | 30.00th=[ 7767], 40.00th=[ 8356], 50.00th=[ 9241], 60.00th=[10945], 00:19:43.172 | 70.00th=[12256], 80.00th=[13960], 90.00th=[16057], 95.00th=[17957], 00:19:43.172 | 99.00th=[20055], 99.50th=[20579], 99.90th=[21365], 99.95th=[21365], 00:19:43.172 | 99.99th=[22152] 00:19:43.172 write: IOPS=6125, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1003msec); 0 zone resets 00:19:43.172 slat (nsec): min=1736, max=4139.7k, avg=82146.62, stdev=367631.09 00:19:43.172 clat (usec): min=3723, max=20976, avg=10625.92, stdev=3453.00 00:19:43.172 lat (usec): min=4216, max=20978, avg=10708.07, stdev=3464.86 00:19:43.172 clat percentiles (usec): 00:19:43.172 | 1.00th=[ 5080], 5.00th=[ 6063], 10.00th=[ 6390], 20.00th=[ 7308], 00:19:43.172 | 30.00th=[ 8029], 40.00th=[ 9110], 50.00th=[10290], 60.00th=[11469], 00:19:43.172 | 70.00th=[12780], 80.00th=[13960], 90.00th=[15533], 95.00th=[16057], 00:19:43.172 | 99.00th=[18744], 99.50th=[19006], 99.90th=[19792], 99.95th=[20841], 00:19:43.172 | 99.99th=[21103] 00:19:43.172 bw ( KiB/s): min=24526, max=24576, per=22.39%, avg=24551.00, stdev=35.36, samples=2 00:19:43.172 iops : min= 6131, max= 6144, avg=6137.50, stdev= 9.19, samples=2 00:19:43.172 lat (msec) : 4=0.05%, 10=51.29%, 20=47.76%, 50=0.89% 00:19:43.172 cpu : usr=2.50%, sys=3.69%, ctx=1287, majf=0, minf=1 00:19:43.172 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:19:43.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.172 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:43.172 issued rwts: total=5928,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.172 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:43.172 00:19:43.172 Run status group 0 (all jobs): 00:19:43.172 READ: bw=103MiB/s (108MB/s), 23.1MiB/s-30.4MiB/s (24.2MB/s-31.9MB/s), io=103MiB (108MB), run=1002-1003msec 00:19:43.172 WRITE: bw=107MiB/s (112MB/s), 23.9MiB/s-31.9MiB/s (25.1MB/s-33.5MB/s), io=107MiB (113MB), run=1002-1003msec 00:19:43.172 00:19:43.172 Disk stats (read/write): 00:19:43.172 nvme0n1: ios=5635/5632, merge=0/0, ticks=16532/14110, in_queue=30642, util=87.47% 00:19:43.172 nvme0n2: ios=6669/6691, merge=0/0, ticks=15626/15581, in_queue=31207, util=87.25% 00:19:43.172 nvme0n3: ios=5137/5632, merge=0/0, ticks=14993/15539, in_queue=30532, util=89.15% 00:19:43.172 nvme0n4: ios=5306/5632, merge=0/0, ticks=14990/15338, in_queue=30328, util=88.98% 00:19:43.172 00:53:49 -- target/fio.sh@55 -- # sync 00:19:43.172 00:53:49 -- target/fio.sh@59 -- # fio_pid=342036 00:19:43.172 00:53:49 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:43.172 00:53:49 -- target/fio.sh@61 -- # sleep 3 00:19:43.172 [global] 00:19:43.172 thread=1 00:19:43.172 invalidate=1 00:19:43.172 rw=read 00:19:43.172 time_based=1 00:19:43.172 runtime=10 00:19:43.172 ioengine=libaio 00:19:43.172 direct=1 00:19:43.172 bs=4096 00:19:43.172 iodepth=1 00:19:43.172 norandommap=1 00:19:43.172 numjobs=1 00:19:43.172 00:19:43.172 [job0] 00:19:43.172 filename=/dev/nvme0n1 00:19:43.172 [job1] 00:19:43.173 filename=/dev/nvme0n2 00:19:43.173 [job2] 00:19:43.173 filename=/dev/nvme0n3 00:19:43.173 [job3] 00:19:43.173 filename=/dev/nvme0n4 00:19:43.173 Could not set queue depth (nvme0n1) 00:19:43.173 Could not set queue depth (nvme0n2) 00:19:43.173 Could not set queue depth (nvme0n3) 00:19:43.173 Could not set queue depth (nvme0n4) 00:19:43.173 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.173 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.173 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.173 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:43.173 fio-3.35 00:19:43.173 Starting 4 threads 00:19:46.459 00:53:52 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:46.459 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=87031808, buflen=4096 00:19:46.459 fio: pid=342314, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:46.459 00:53:53 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:46.459 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=88186880, buflen=4096 00:19:46.459 fio: pid=342308, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:46.459 00:53:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.459 00:53:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:46.459 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=30334976, buflen=4096 00:19:46.459 fio: pid=342274, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:46.459 00:53:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.459 00:53:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:46.459 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=44814336, buflen=4096 00:19:46.459 fio: pid=342288, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:19:46.719 00:53:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.719 00:53:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:46.719 00:19:46.719 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=342274: Fri Apr 26 00:53:53 2024 00:19:46.719 read: IOPS=7810, BW=30.5MiB/s (32.0MB/s)(92.9MiB/3046msec) 00:19:46.719 slat (usec): min=6, max=11766, avg= 8.57, stdev=132.29 00:19:46.719 clat (usec): min=45, max=320, avg=117.32, stdev=31.13 00:19:46.719 lat (usec): min=51, max=11843, avg=125.89, stdev=135.50 00:19:46.719 clat percentiles (usec): 00:19:46.719 | 1.00th=[ 59], 5.00th=[ 72], 10.00th=[ 77], 20.00th=[ 83], 00:19:46.719 | 30.00th=[ 93], 40.00th=[ 118], 50.00th=[ 122], 60.00th=[ 125], 00:19:46.719 | 70.00th=[ 129], 80.00th=[ 137], 90.00th=[ 165], 95.00th=[ 172], 00:19:46.719 | 99.00th=[ 180], 99.50th=[ 182], 99.90th=[ 190], 99.95th=[ 196], 00:19:46.719 | 99.99th=[ 285] 00:19:46.719 bw ( KiB/s): min=29988, max=30480, per=25.79%, avg=30216.80, stdev=175.51, samples=5 00:19:46.719 iops : min= 7497, max= 7620, avg=7554.20, stdev=43.88, samples=5 00:19:46.719 lat (usec) : 50=0.08%, 100=30.81%, 250=69.09%, 500=0.02% 00:19:46.719 cpu : usr=2.00%, sys=6.40%, ctx=23795, majf=0, minf=1 00:19:46.719 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 issued rwts: total=23791,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.719 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.719 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=342288: Fri Apr 26 00:53:53 2024 00:19:46.719 read: IOPS=8523, BW=33.3MiB/s (34.9MB/s)(107MiB/3206msec) 00:19:46.719 slat (usec): min=5, max=19430, avg= 9.45, stdev=187.21 00:19:46.719 clat (usec): min=35, max=309, avg=106.50, stdev=28.45 00:19:46.719 lat (usec): min=52, max=19512, avg=115.95, stdev=188.97 00:19:46.719 clat percentiles (usec): 00:19:46.719 | 1.00th=[ 50], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 76], 00:19:46.719 | 30.00th=[ 91], 40.00th=[ 113], 50.00th=[ 117], 60.00th=[ 119], 00:19:46.719 | 70.00th=[ 121], 80.00th=[ 124], 90.00th=[ 133], 95.00th=[ 155], 00:19:46.719 | 99.00th=[ 163], 99.50th=[ 165], 99.90th=[ 174], 99.95th=[ 178], 00:19:46.719 | 99.99th=[ 239] 00:19:46.719 bw ( KiB/s): min=31800, max=39762, per=28.32%, avg=33171.00, stdev=3229.17, samples=6 00:19:46.719 iops : min= 7950, max= 9940, avg=8292.67, stdev=807.09, samples=6 00:19:46.719 lat (usec) : 50=1.04%, 100=29.47%, 250=69.48%, 500=0.01% 00:19:46.719 cpu : usr=2.18%, sys=6.83%, ctx=27334, majf=0, minf=1 00:19:46.719 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 issued rwts: total=27326,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.719 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.719 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=342308: Fri Apr 26 00:53:53 2024 00:19:46.719 read: IOPS=7536, BW=29.4MiB/s (30.9MB/s)(84.1MiB/2857msec) 00:19:46.719 slat (usec): min=6, max=13838, avg= 8.05, stdev=115.59 00:19:46.719 clat (usec): min=68, max=291, avg=123.11, stdev=16.05 00:19:46.719 lat (usec): min=75, max=13928, avg=131.16, stdev=116.45 00:19:46.719 clat percentiles (usec): 00:19:46.719 | 1.00th=[ 81], 5.00th=[ 89], 10.00th=[ 108], 20.00th=[ 117], 00:19:46.719 | 30.00th=[ 120], 40.00th=[ 122], 50.00th=[ 124], 60.00th=[ 126], 00:19:46.719 | 70.00th=[ 129], 80.00th=[ 133], 90.00th=[ 137], 95.00th=[ 155], 00:19:46.719 | 99.00th=[ 167], 99.50th=[ 172], 99.90th=[ 180], 99.95th=[ 186], 00:19:46.719 | 99.99th=[ 289] 00:19:46.719 bw ( KiB/s): min=29980, max=30360, per=25.77%, avg=30189.60, stdev=136.16, samples=5 00:19:46.719 iops : min= 7495, max= 7590, avg=7547.40, stdev=34.04, samples=5 00:19:46.719 lat (usec) : 100=9.24%, 250=90.74%, 500=0.02% 00:19:46.719 cpu : usr=2.07%, sys=6.13%, ctx=21534, majf=0, minf=1 00:19:46.719 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 issued rwts: total=21531,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.719 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.719 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=342314: Fri Apr 26 00:53:53 2024 00:19:46.719 read: IOPS=7928, BW=31.0MiB/s (32.5MB/s)(83.0MiB/2680msec) 00:19:46.719 slat (nsec): min=6114, max=61362, avg=6915.15, stdev=771.40 00:19:46.719 clat (usec): min=63, max=301, avg=117.66, stdev=13.20 00:19:46.719 lat (usec): min=72, max=308, avg=124.57, stdev=13.23 00:19:46.719 clat percentiles (usec): 00:19:46.719 | 1.00th=[ 81], 5.00th=[ 88], 10.00th=[ 106], 20.00th=[ 113], 00:19:46.719 | 30.00th=[ 116], 40.00th=[ 117], 50.00th=[ 119], 60.00th=[ 120], 00:19:46.719 | 70.00th=[ 122], 80.00th=[ 124], 90.00th=[ 129], 95.00th=[ 145], 00:19:46.719 | 99.00th=[ 155], 99.50th=[ 157], 99.90th=[ 163], 99.95th=[ 165], 00:19:46.719 | 99.99th=[ 169] 00:19:46.719 bw ( KiB/s): min=31800, max=31912, per=27.19%, avg=31857.60, stdev=54.67, samples=5 00:19:46.719 iops : min= 7950, max= 7978, avg=7964.40, stdev=13.67, samples=5 00:19:46.719 lat (usec) : 100=7.28%, 250=92.71%, 500=0.01% 00:19:46.719 cpu : usr=1.83%, sys=6.76%, ctx=21249, majf=0, minf=2 00:19:46.719 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:46.719 issued rwts: total=21249,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:46.719 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:46.719 00:19:46.719 Run status group 0 (all jobs): 00:19:46.719 READ: bw=114MiB/s (120MB/s), 29.4MiB/s-33.3MiB/s (30.9MB/s-34.9MB/s), io=367MiB (385MB), run=2680-3206msec 00:19:46.719 00:19:46.719 Disk stats (read/write): 00:19:46.719 nvme0n1: ios=21992/0, merge=0/0, ticks=2589/0, in_queue=2589, util=94.89% 00:19:46.719 nvme0n2: ios=25939/0, merge=0/0, ticks=2746/0, in_queue=2746, util=94.12% 00:19:46.719 nvme0n3: ios=19687/0, merge=0/0, ticks=2373/0, in_queue=2373, util=96.17% 00:19:46.719 nvme0n4: ios=20766/0, merge=0/0, ticks=2360/0, in_queue=2360, util=96.42% 00:19:46.719 00:53:53 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.719 00:53:53 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:46.979 00:53:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.979 00:53:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:47.239 00:53:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:47.239 00:53:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:47.239 00:53:54 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:47.239 00:53:54 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:47.499 00:53:54 -- target/fio.sh@69 -- # fio_status=0 00:19:47.499 00:53:54 -- target/fio.sh@70 -- # wait 342036 00:19:47.499 00:53:54 -- target/fio.sh@70 -- # fio_status=4 00:19:47.499 00:53:54 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:48.437 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:48.437 00:53:55 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:48.437 00:53:55 -- common/autotest_common.sh@1205 -- # local i=0 00:19:48.437 00:53:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:48.437 00:53:55 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:19:48.437 00:53:55 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:19:48.437 00:53:55 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:48.437 00:53:55 -- common/autotest_common.sh@1217 -- # return 0 00:19:48.437 00:53:55 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:48.437 00:53:55 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:48.437 nvmf hotplug test: fio failed as expected 00:19:48.437 00:53:55 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:48.437 00:53:55 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:48.697 00:53:55 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:48.697 00:53:55 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:48.697 00:53:55 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:48.697 00:53:55 -- target/fio.sh@91 -- # nvmftestfini 00:19:48.697 00:53:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:48.697 00:53:55 -- nvmf/common.sh@117 -- # sync 00:19:48.697 00:53:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:48.697 00:53:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:48.697 00:53:55 -- nvmf/common.sh@120 -- # set +e 00:19:48.697 00:53:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:48.697 00:53:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:48.697 rmmod nvme_rdma 00:19:48.697 rmmod nvme_fabrics 00:19:48.697 00:53:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:48.697 00:53:55 -- nvmf/common.sh@124 -- # set -e 00:19:48.697 00:53:55 -- nvmf/common.sh@125 -- # return 0 00:19:48.697 00:53:55 -- nvmf/common.sh@478 -- # '[' -n 339012 ']' 00:19:48.697 00:53:55 -- nvmf/common.sh@479 -- # killprocess 339012 00:19:48.697 00:53:55 -- common/autotest_common.sh@936 -- # '[' -z 339012 ']' 00:19:48.697 00:53:55 -- common/autotest_common.sh@940 -- # kill -0 339012 00:19:48.697 00:53:55 -- common/autotest_common.sh@941 -- # uname 00:19:48.697 00:53:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:48.697 00:53:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 339012 00:19:48.697 00:53:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:48.697 00:53:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:48.697 00:53:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 339012' 00:19:48.697 killing process with pid 339012 00:19:48.697 00:53:55 -- common/autotest_common.sh@955 -- # kill 339012 00:19:48.697 00:53:55 -- common/autotest_common.sh@960 -- # wait 339012 00:19:48.697 [2024-04-26 00:53:55.796589] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:48.958 00:53:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:48.958 00:53:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:48.958 00:19:48.958 real 0m24.396s 00:19:48.958 user 2m0.149s 00:19:48.958 sys 0m8.171s 00:19:48.958 00:53:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:48.958 00:53:55 -- common/autotest_common.sh@10 -- # set +x 00:19:48.958 ************************************ 00:19:48.958 END TEST nvmf_fio_target 00:19:48.958 ************************************ 00:19:48.958 00:53:56 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:48.958 00:53:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:48.958 00:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:48.958 00:53:56 -- common/autotest_common.sh@10 -- # set +x 00:19:49.217 ************************************ 00:19:49.217 START TEST nvmf_bdevio 00:19:49.217 ************************************ 00:19:49.217 00:53:56 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:19:49.217 * Looking for test storage... 00:19:49.217 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:49.217 00:53:56 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:49.217 00:53:56 -- nvmf/common.sh@7 -- # uname -s 00:19:49.217 00:53:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:49.217 00:53:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:49.217 00:53:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:49.217 00:53:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:49.217 00:53:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:49.217 00:53:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:49.217 00:53:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:49.217 00:53:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:49.217 00:53:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:49.217 00:53:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:49.217 00:53:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:49.217 00:53:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:49.217 00:53:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:49.217 00:53:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:49.217 00:53:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:49.217 00:53:56 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:49.217 00:53:56 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:49.217 00:53:56 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:49.217 00:53:56 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:49.217 00:53:56 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:49.217 00:53:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.217 00:53:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.217 00:53:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.218 00:53:56 -- paths/export.sh@5 -- # export PATH 00:19:49.218 00:53:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.218 00:53:56 -- nvmf/common.sh@47 -- # : 0 00:19:49.218 00:53:56 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:49.218 00:53:56 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:49.218 00:53:56 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:49.218 00:53:56 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:49.218 00:53:56 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:49.218 00:53:56 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:49.218 00:53:56 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:49.218 00:53:56 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:49.218 00:53:56 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:49.218 00:53:56 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:49.218 00:53:56 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:49.218 00:53:56 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:49.218 00:53:56 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:49.218 00:53:56 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:49.218 00:53:56 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:49.218 00:53:56 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:49.218 00:53:56 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:49.218 00:53:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:49.218 00:53:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:49.218 00:53:56 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:49.218 00:53:56 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:49.218 00:53:56 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:49.218 00:53:56 -- common/autotest_common.sh@10 -- # set +x 00:19:54.493 00:54:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:54.493 00:54:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:54.493 00:54:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:54.494 00:54:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:54.494 00:54:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:54.494 00:54:01 -- nvmf/common.sh@295 -- # net_devs=() 00:19:54.494 00:54:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@296 -- # e810=() 00:19:54.494 00:54:01 -- nvmf/common.sh@296 -- # local -ga e810 00:19:54.494 00:54:01 -- nvmf/common.sh@297 -- # x722=() 00:19:54.494 00:54:01 -- nvmf/common.sh@297 -- # local -ga x722 00:19:54.494 00:54:01 -- nvmf/common.sh@298 -- # mlx=() 00:19:54.494 00:54:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:54.494 00:54:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:54.494 00:54:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:54.494 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:54.494 00:54:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:54.494 00:54:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:54.494 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:54.494 00:54:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:54.494 00:54:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.494 00:54:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.494 00:54:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:54.494 Found net devices under 0000:18:00.0: mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.494 00:54:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.494 00:54:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:54.494 Found net devices under 0000:18:00.1: mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.494 00:54:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:54.494 00:54:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:54.494 00:54:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:54.494 00:54:01 -- nvmf/common.sh@58 -- # uname 00:19:54.494 00:54:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:54.494 00:54:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:54.494 00:54:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:54.494 00:54:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:54.494 00:54:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:54.494 00:54:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:54.494 00:54:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:54.494 00:54:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:54.494 00:54:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:54.494 00:54:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:54.494 00:54:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:54.494 00:54:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:54.494 00:54:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:54.494 00:54:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@105 -- # continue 2 00:19:54.494 00:54:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@105 -- # continue 2 00:19:54.494 00:54:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:54.494 00:54:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:54.494 00:54:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:54.494 00:54:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:54.494 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:54.494 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:19:54.494 altname enp24s0f0np0 00:19:54.494 altname ens785f0np0 00:19:54.494 inet 192.168.100.8/24 scope global mlx_0_0 00:19:54.494 valid_lft forever preferred_lft forever 00:19:54.494 00:54:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:54.494 00:54:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:54.494 00:54:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:54.494 00:54:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:54.494 00:54:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:54.494 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:54.494 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:19:54.494 altname enp24s0f1np1 00:19:54.494 altname ens785f1np1 00:19:54.494 inet 192.168.100.9/24 scope global mlx_0_1 00:19:54.494 valid_lft forever preferred_lft forever 00:19:54.494 00:54:01 -- nvmf/common.sh@411 -- # return 0 00:19:54.494 00:54:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:54.494 00:54:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:54.494 00:54:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:54.494 00:54:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:54.494 00:54:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:54.494 00:54:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:54.494 00:54:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:54.494 00:54:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:54.494 00:54:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:54.494 00:54:01 -- nvmf/common.sh@105 -- # continue 2 00:19:54.494 00:54:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:54.494 00:54:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:54.494 00:54:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:54.494 00:54:01 -- nvmf/common.sh@105 -- # continue 2 00:19:54.494 00:54:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:54.495 00:54:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:54.495 00:54:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:54.495 00:54:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:54.495 00:54:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:54.495 00:54:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:54.495 00:54:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:54.495 00:54:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:54.495 192.168.100.9' 00:19:54.495 00:54:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:54.495 192.168.100.9' 00:19:54.495 00:54:01 -- nvmf/common.sh@446 -- # head -n 1 00:19:54.495 00:54:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:54.495 00:54:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:54.495 192.168.100.9' 00:19:54.495 00:54:01 -- nvmf/common.sh@447 -- # tail -n +2 00:19:54.495 00:54:01 -- nvmf/common.sh@447 -- # head -n 1 00:19:54.495 00:54:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:54.495 00:54:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:54.495 00:54:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:54.495 00:54:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:54.495 00:54:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:54.495 00:54:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:54.495 00:54:01 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:54.495 00:54:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:54.495 00:54:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:19:54.495 00:54:01 -- common/autotest_common.sh@10 -- # set +x 00:19:54.495 00:54:01 -- nvmf/common.sh@470 -- # nvmfpid=346626 00:19:54.495 00:54:01 -- nvmf/common.sh@471 -- # waitforlisten 346626 00:19:54.495 00:54:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:54.495 00:54:01 -- common/autotest_common.sh@817 -- # '[' -z 346626 ']' 00:19:54.495 00:54:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:54.495 00:54:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:19:54.495 00:54:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:54.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:54.495 00:54:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:19:54.495 00:54:01 -- common/autotest_common.sh@10 -- # set +x 00:19:54.495 [2024-04-26 00:54:01.599020] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:19:54.495 [2024-04-26 00:54:01.599062] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:54.495 EAL: No free 2048 kB hugepages reported on node 1 00:19:54.495 [2024-04-26 00:54:01.647955] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:54.755 [2024-04-26 00:54:01.718589] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:54.755 [2024-04-26 00:54:01.718621] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:54.755 [2024-04-26 00:54:01.718628] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:54.755 [2024-04-26 00:54:01.718634] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:54.755 [2024-04-26 00:54:01.718639] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:54.755 [2024-04-26 00:54:01.718748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:54.755 [2024-04-26 00:54:01.718868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:54.755 [2024-04-26 00:54:01.718973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:54.755 [2024-04-26 00:54:01.718974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:55.322 00:54:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:19:55.322 00:54:02 -- common/autotest_common.sh@850 -- # return 0 00:19:55.322 00:54:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:55.322 00:54:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:19:55.322 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.322 00:54:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:55.322 00:54:02 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:55.322 00:54:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.322 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.322 [2024-04-26 00:54:02.444109] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1827160/0x182b650) succeed. 00:19:55.322 [2024-04-26 00:54:02.453381] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x18287a0/0x186cce0) succeed. 00:19:55.580 00:54:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.580 00:54:02 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:55.580 00:54:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.580 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.580 Malloc0 00:19:55.580 00:54:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.580 00:54:02 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:55.580 00:54:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.580 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.580 00:54:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.580 00:54:02 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:55.580 00:54:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.580 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.580 00:54:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.580 00:54:02 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:55.580 00:54:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:55.580 00:54:02 -- common/autotest_common.sh@10 -- # set +x 00:19:55.580 [2024-04-26 00:54:02.601204] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:55.580 00:54:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:55.580 00:54:02 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:55.580 00:54:02 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:55.580 00:54:02 -- nvmf/common.sh@521 -- # config=() 00:19:55.580 00:54:02 -- nvmf/common.sh@521 -- # local subsystem config 00:19:55.580 00:54:02 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:55.580 00:54:02 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:55.580 { 00:19:55.580 "params": { 00:19:55.580 "name": "Nvme$subsystem", 00:19:55.580 "trtype": "$TEST_TRANSPORT", 00:19:55.580 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:55.580 "adrfam": "ipv4", 00:19:55.580 "trsvcid": "$NVMF_PORT", 00:19:55.580 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:55.580 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:55.580 "hdgst": ${hdgst:-false}, 00:19:55.580 "ddgst": ${ddgst:-false} 00:19:55.580 }, 00:19:55.580 "method": "bdev_nvme_attach_controller" 00:19:55.580 } 00:19:55.580 EOF 00:19:55.580 )") 00:19:55.580 00:54:02 -- nvmf/common.sh@543 -- # cat 00:19:55.580 00:54:02 -- nvmf/common.sh@545 -- # jq . 00:19:55.580 00:54:02 -- nvmf/common.sh@546 -- # IFS=, 00:19:55.580 00:54:02 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:55.580 "params": { 00:19:55.580 "name": "Nvme1", 00:19:55.581 "trtype": "rdma", 00:19:55.581 "traddr": "192.168.100.8", 00:19:55.581 "adrfam": "ipv4", 00:19:55.581 "trsvcid": "4420", 00:19:55.581 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:55.581 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:55.581 "hdgst": false, 00:19:55.581 "ddgst": false 00:19:55.581 }, 00:19:55.581 "method": "bdev_nvme_attach_controller" 00:19:55.581 }' 00:19:55.581 [2024-04-26 00:54:02.644993] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:19:55.581 [2024-04-26 00:54:02.645035] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid346920 ] 00:19:55.581 EAL: No free 2048 kB hugepages reported on node 1 00:19:55.581 [2024-04-26 00:54:02.696571] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:55.581 [2024-04-26 00:54:02.765311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:55.581 [2024-04-26 00:54:02.765405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:55.581 [2024-04-26 00:54:02.765406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:55.840 I/O targets: 00:19:55.840 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:55.840 00:19:55.840 00:19:55.840 CUnit - A unit testing framework for C - Version 2.1-3 00:19:55.840 http://cunit.sourceforge.net/ 00:19:55.840 00:19:55.840 00:19:55.840 Suite: bdevio tests on: Nvme1n1 00:19:55.840 Test: blockdev write read block ...passed 00:19:55.840 Test: blockdev write zeroes read block ...passed 00:19:55.840 Test: blockdev write zeroes read no split ...passed 00:19:55.840 Test: blockdev write zeroes read split ...passed 00:19:55.840 Test: blockdev write zeroes read split partial ...passed 00:19:55.840 Test: blockdev reset ...[2024-04-26 00:54:02.973559] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:55.840 [2024-04-26 00:54:02.995287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:55.840 [2024-04-26 00:54:03.022909] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:55.840 passed 00:19:55.840 Test: blockdev write read 8 blocks ...passed 00:19:55.840 Test: blockdev write read size > 128k ...passed 00:19:55.840 Test: blockdev write read invalid size ...passed 00:19:55.840 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:55.840 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:55.840 Test: blockdev write read max offset ...passed 00:19:55.840 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:55.840 Test: blockdev writev readv 8 blocks ...passed 00:19:55.840 Test: blockdev writev readv 30 x 1block ...passed 00:19:55.840 Test: blockdev writev readv block ...passed 00:19:55.840 Test: blockdev writev readv size > 128k ...passed 00:19:55.840 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:55.840 Test: blockdev comparev and writev ...[2024-04-26 00:54:03.025652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.025680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.025689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.025696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.025860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.025868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.025875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.025881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.026049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.026062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.026235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:55.840 [2024-04-26 00:54:03.026251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:55.840 passed 00:19:55.840 Test: blockdev nvme passthru rw ...passed 00:19:55.840 Test: blockdev nvme passthru vendor specific ...[2024-04-26 00:54:03.026523] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:55.840 [2024-04-26 00:54:03.026532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:55.840 [2024-04-26 00:54:03.026576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026617] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:55.840 [2024-04-26 00:54:03.026625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:55.840 [2024-04-26 00:54:03.026663] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:55.840 [2024-04-26 00:54:03.026669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:55.840 passed 00:19:55.840 Test: blockdev nvme admin passthru ...passed 00:19:55.840 Test: blockdev copy ...passed 00:19:55.840 00:19:55.840 Run Summary: Type Total Ran Passed Failed Inactive 00:19:55.840 suites 1 1 n/a 0 0 00:19:55.840 tests 23 23 23 0 0 00:19:55.840 asserts 152 152 152 0 n/a 00:19:55.840 00:19:55.840 Elapsed time = 0.168 seconds 00:19:56.099 00:54:03 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:56.099 00:54:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:19:56.099 00:54:03 -- common/autotest_common.sh@10 -- # set +x 00:19:56.099 00:54:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:19:56.099 00:54:03 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:56.099 00:54:03 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:56.099 00:54:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:56.099 00:54:03 -- nvmf/common.sh@117 -- # sync 00:19:56.099 00:54:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:56.099 00:54:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:56.099 00:54:03 -- nvmf/common.sh@120 -- # set +e 00:19:56.099 00:54:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:56.099 00:54:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:56.099 rmmod nvme_rdma 00:19:56.099 rmmod nvme_fabrics 00:19:56.099 00:54:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:56.099 00:54:03 -- nvmf/common.sh@124 -- # set -e 00:19:56.099 00:54:03 -- nvmf/common.sh@125 -- # return 0 00:19:56.099 00:54:03 -- nvmf/common.sh@478 -- # '[' -n 346626 ']' 00:19:56.099 00:54:03 -- nvmf/common.sh@479 -- # killprocess 346626 00:19:56.099 00:54:03 -- common/autotest_common.sh@936 -- # '[' -z 346626 ']' 00:19:56.099 00:54:03 -- common/autotest_common.sh@940 -- # kill -0 346626 00:19:56.099 00:54:03 -- common/autotest_common.sh@941 -- # uname 00:19:56.099 00:54:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:56.099 00:54:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 346626 00:19:56.358 00:54:03 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:56.358 00:54:03 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:56.358 00:54:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 346626' 00:19:56.358 killing process with pid 346626 00:19:56.358 00:54:03 -- common/autotest_common.sh@955 -- # kill 346626 00:19:56.358 00:54:03 -- common/autotest_common.sh@960 -- # wait 346626 00:19:56.358 [2024-04-26 00:54:03.406028] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:56.618 00:54:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:56.618 00:54:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:56.618 00:19:56.618 real 0m7.468s 00:19:56.618 user 0m10.143s 00:19:56.618 sys 0m4.440s 00:19:56.618 00:54:03 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:19:56.618 00:54:03 -- common/autotest_common.sh@10 -- # set +x 00:19:56.618 ************************************ 00:19:56.618 END TEST nvmf_bdevio 00:19:56.618 ************************************ 00:19:56.618 00:54:03 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:19:56.618 00:54:03 -- nvmf/nvmf.sh@64 -- # '[' 1 -eq 1 ']' 00:19:56.618 00:54:03 -- nvmf/nvmf.sh@65 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:56.618 00:54:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:56.618 00:54:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:56.618 00:54:03 -- common/autotest_common.sh@10 -- # set +x 00:19:56.618 ************************************ 00:19:56.618 START TEST nvmf_fuzz 00:19:56.618 ************************************ 00:19:56.618 00:54:03 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=rdma 00:19:56.877 * Looking for test storage... 00:19:56.877 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:19:56.877 00:54:03 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:56.877 00:54:03 -- nvmf/common.sh@7 -- # uname -s 00:19:56.877 00:54:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:56.877 00:54:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:56.877 00:54:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:56.877 00:54:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:56.877 00:54:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:56.877 00:54:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:56.877 00:54:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:56.877 00:54:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:56.877 00:54:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:56.877 00:54:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:56.877 00:54:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:19:56.877 00:54:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:19:56.877 00:54:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:56.877 00:54:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:56.877 00:54:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:56.877 00:54:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:56.877 00:54:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:56.877 00:54:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:56.877 00:54:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:56.877 00:54:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:56.877 00:54:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.877 00:54:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.877 00:54:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.877 00:54:03 -- paths/export.sh@5 -- # export PATH 00:19:56.877 00:54:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.877 00:54:03 -- nvmf/common.sh@47 -- # : 0 00:19:56.877 00:54:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:56.877 00:54:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:56.877 00:54:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:56.877 00:54:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:56.877 00:54:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:56.877 00:54:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:56.877 00:54:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:56.877 00:54:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:56.877 00:54:03 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:56.877 00:54:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:56.877 00:54:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:56.877 00:54:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:56.877 00:54:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:56.877 00:54:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:56.877 00:54:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:56.877 00:54:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:56.877 00:54:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.877 00:54:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:56.877 00:54:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:56.877 00:54:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:56.877 00:54:03 -- common/autotest_common.sh@10 -- # set +x 00:20:02.144 00:54:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:02.144 00:54:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:02.144 00:54:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:02.144 00:54:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:02.144 00:54:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:02.144 00:54:09 -- nvmf/common.sh@295 -- # net_devs=() 00:20:02.144 00:54:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@296 -- # e810=() 00:20:02.144 00:54:09 -- nvmf/common.sh@296 -- # local -ga e810 00:20:02.144 00:54:09 -- nvmf/common.sh@297 -- # x722=() 00:20:02.144 00:54:09 -- nvmf/common.sh@297 -- # local -ga x722 00:20:02.144 00:54:09 -- nvmf/common.sh@298 -- # mlx=() 00:20:02.144 00:54:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:02.144 00:54:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:02.144 00:54:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:02.144 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:02.144 00:54:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:02.144 00:54:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:02.144 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:02.144 00:54:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:02.144 00:54:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.144 00:54:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.144 00:54:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:02.144 Found net devices under 0000:18:00.0: mlx_0_0 00:20:02.144 00:54:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.144 00:54:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.144 00:54:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:02.144 Found net devices under 0000:18:00.1: mlx_0_1 00:20:02.144 00:54:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.144 00:54:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:02.144 00:54:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:02.144 00:54:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:02.144 00:54:09 -- nvmf/common.sh@58 -- # uname 00:20:02.144 00:54:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:02.144 00:54:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:02.144 00:54:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:02.144 00:54:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:02.144 00:54:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:02.144 00:54:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:02.144 00:54:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:02.144 00:54:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:02.144 00:54:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:02.144 00:54:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:02.144 00:54:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:02.144 00:54:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:02.144 00:54:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:02.144 00:54:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:02.144 00:54:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:02.144 00:54:09 -- nvmf/common.sh@105 -- # continue 2 00:20:02.144 00:54:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.144 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:02.144 00:54:09 -- nvmf/common.sh@105 -- # continue 2 00:20:02.144 00:54:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:02.144 00:54:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:02.144 00:54:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:02.144 00:54:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:02.144 00:54:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:02.144 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:02.144 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:20:02.144 altname enp24s0f0np0 00:20:02.144 altname ens785f0np0 00:20:02.144 inet 192.168.100.8/24 scope global mlx_0_0 00:20:02.144 valid_lft forever preferred_lft forever 00:20:02.144 00:54:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:02.144 00:54:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:02.144 00:54:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:02.144 00:54:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:02.144 00:54:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:02.144 00:54:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:02.144 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:02.144 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:20:02.144 altname enp24s0f1np1 00:20:02.144 altname ens785f1np1 00:20:02.144 inet 192.168.100.9/24 scope global mlx_0_1 00:20:02.144 valid_lft forever preferred_lft forever 00:20:02.144 00:54:09 -- nvmf/common.sh@411 -- # return 0 00:20:02.144 00:54:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:02.144 00:54:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:02.144 00:54:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:02.144 00:54:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:02.144 00:54:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:02.144 00:54:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:02.144 00:54:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:02.145 00:54:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:02.145 00:54:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:02.145 00:54:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:02.145 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.145 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:02.145 00:54:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:02.145 00:54:09 -- nvmf/common.sh@105 -- # continue 2 00:20:02.145 00:54:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:02.145 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.145 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:02.145 00:54:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:02.145 00:54:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:02.145 00:54:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:02.145 00:54:09 -- nvmf/common.sh@105 -- # continue 2 00:20:02.145 00:54:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:02.145 00:54:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:02.145 00:54:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:02.145 00:54:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:02.145 00:54:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:02.145 00:54:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:02.145 00:54:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:02.145 00:54:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:02.145 192.168.100.9' 00:20:02.145 00:54:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:02.145 192.168.100.9' 00:20:02.145 00:54:09 -- nvmf/common.sh@446 -- # head -n 1 00:20:02.145 00:54:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:02.145 00:54:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:02.145 192.168.100.9' 00:20:02.145 00:54:09 -- nvmf/common.sh@447 -- # tail -n +2 00:20:02.145 00:54:09 -- nvmf/common.sh@447 -- # head -n 1 00:20:02.404 00:54:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:02.404 00:54:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:02.404 00:54:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:02.404 00:54:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:02.404 00:54:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:02.404 00:54:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:02.404 00:54:09 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=350859 00:20:02.404 00:54:09 -- target/fabrics_fuzz.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:20:02.404 00:54:09 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:02.405 00:54:09 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 350859 00:20:02.405 00:54:09 -- common/autotest_common.sh@817 -- # '[' -z 350859 ']' 00:20:02.405 00:54:09 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:02.405 00:54:09 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:02.405 00:54:09 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:02.405 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:02.405 00:54:09 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:02.405 00:54:09 -- common/autotest_common.sh@10 -- # set +x 00:20:02.974 00:54:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:02.974 00:54:10 -- common/autotest_common.sh@850 -- # return 0 00:20:02.974 00:54:10 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:02.974 00:54:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:02.974 00:54:10 -- common/autotest_common.sh@10 -- # set +x 00:20:03.234 00:54:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:20:03.234 00:54:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.234 00:54:10 -- common/autotest_common.sh@10 -- # set +x 00:20:03.234 Malloc0 00:20:03.234 00:54:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:03.234 00:54:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.234 00:54:10 -- common/autotest_common.sh@10 -- # set +x 00:20:03.234 00:54:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:03.234 00:54:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.234 00:54:10 -- common/autotest_common.sh@10 -- # set +x 00:20:03.234 00:54:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:03.234 00:54:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:03.234 00:54:10 -- common/autotest_common.sh@10 -- # set +x 00:20:03.234 00:54:10 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' 00:20:03.234 00:54:10 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -t 30 -S 123456 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -N -a 00:20:35.326 Fuzzing completed. Shutting down the fuzz application 00:20:35.326 00:20:35.326 Dumping successful admin opcodes: 00:20:35.326 8, 9, 10, 24, 00:20:35.326 Dumping successful io opcodes: 00:20:35.326 0, 9, 00:20:35.326 NS: 0x200003af1f00 I/O qp, Total commands completed: 1426114, total successful commands: 8420, random_seed: 3023560384 00:20:35.326 NS: 0x200003af1f00 admin qp, Total commands completed: 180320, total successful commands: 1454, random_seed: 3031827264 00:20:35.326 00:54:40 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -F 'trtype:rdma adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:192.168.100.8 trsvcid:4420' -j /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:20:35.326 Fuzzing completed. Shutting down the fuzz application 00:20:35.326 00:20:35.326 Dumping successful admin opcodes: 00:20:35.326 24, 00:20:35.326 Dumping successful io opcodes: 00:20:35.326 00:20:35.326 NS: 0x200003af1f00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 3212883640 00:20:35.326 NS: 0x200003af1f00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 3212960824 00:20:35.326 00:54:42 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:35.326 00:54:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:35.326 00:54:42 -- common/autotest_common.sh@10 -- # set +x 00:20:35.326 00:54:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:35.326 00:54:42 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:20:35.326 00:54:42 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:20:35.326 00:54:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:35.326 00:54:42 -- nvmf/common.sh@117 -- # sync 00:20:35.326 00:54:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:35.326 00:54:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:35.326 00:54:42 -- nvmf/common.sh@120 -- # set +e 00:20:35.326 00:54:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:35.326 00:54:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:35.326 rmmod nvme_rdma 00:20:35.326 rmmod nvme_fabrics 00:20:35.326 00:54:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:35.326 00:54:42 -- nvmf/common.sh@124 -- # set -e 00:20:35.327 00:54:42 -- nvmf/common.sh@125 -- # return 0 00:20:35.327 00:54:42 -- nvmf/common.sh@478 -- # '[' -n 350859 ']' 00:20:35.327 00:54:42 -- nvmf/common.sh@479 -- # killprocess 350859 00:20:35.327 00:54:42 -- common/autotest_common.sh@936 -- # '[' -z 350859 ']' 00:20:35.327 00:54:42 -- common/autotest_common.sh@940 -- # kill -0 350859 00:20:35.327 00:54:42 -- common/autotest_common.sh@941 -- # uname 00:20:35.327 00:54:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.327 00:54:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 350859 00:20:35.327 00:54:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:35.327 00:54:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:35.327 00:54:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 350859' 00:20:35.327 killing process with pid 350859 00:20:35.327 00:54:42 -- common/autotest_common.sh@955 -- # kill 350859 00:20:35.327 00:54:42 -- common/autotest_common.sh@960 -- # wait 350859 00:20:35.327 00:54:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:35.327 00:54:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:35.327 00:54:42 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:20:35.327 00:20:35.327 real 0m38.637s 00:20:35.327 user 0m53.390s 00:20:35.327 sys 0m16.423s 00:20:35.327 00:54:42 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:20:35.327 00:54:42 -- common/autotest_common.sh@10 -- # set +x 00:20:35.327 ************************************ 00:20:35.327 END TEST nvmf_fuzz 00:20:35.327 ************************************ 00:20:35.327 00:54:42 -- nvmf/nvmf.sh@66 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:35.327 00:54:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:35.327 00:54:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:35.327 00:54:42 -- common/autotest_common.sh@10 -- # set +x 00:20:35.587 ************************************ 00:20:35.587 START TEST nvmf_multiconnection 00:20:35.587 ************************************ 00:20:35.587 00:54:42 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=rdma 00:20:35.587 * Looking for test storage... 00:20:35.587 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:20:35.587 00:54:42 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:35.587 00:54:42 -- nvmf/common.sh@7 -- # uname -s 00:20:35.587 00:54:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:35.587 00:54:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:35.587 00:54:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:35.587 00:54:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:35.587 00:54:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:35.587 00:54:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:35.587 00:54:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:35.587 00:54:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:35.588 00:54:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:35.588 00:54:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:35.588 00:54:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:20:35.588 00:54:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:20:35.588 00:54:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:35.588 00:54:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:35.588 00:54:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:35.588 00:54:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:35.588 00:54:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:35.588 00:54:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:35.588 00:54:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:35.588 00:54:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:35.588 00:54:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.588 00:54:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.588 00:54:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.588 00:54:42 -- paths/export.sh@5 -- # export PATH 00:20:35.588 00:54:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:35.588 00:54:42 -- nvmf/common.sh@47 -- # : 0 00:20:35.588 00:54:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:35.588 00:54:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:35.588 00:54:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:35.588 00:54:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:35.588 00:54:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:35.588 00:54:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:35.588 00:54:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:35.588 00:54:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:35.588 00:54:42 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:35.588 00:54:42 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:35.588 00:54:42 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:20:35.588 00:54:42 -- target/multiconnection.sh@16 -- # nvmftestinit 00:20:35.588 00:54:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:35.588 00:54:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:35.588 00:54:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:35.588 00:54:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:35.588 00:54:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:35.588 00:54:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:35.588 00:54:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:35.588 00:54:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:35.588 00:54:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:35.588 00:54:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:35.588 00:54:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:35.588 00:54:42 -- common/autotest_common.sh@10 -- # set +x 00:20:40.860 00:54:47 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:40.860 00:54:47 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:40.860 00:54:47 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:40.860 00:54:47 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:40.860 00:54:47 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:40.860 00:54:47 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:40.860 00:54:47 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:40.860 00:54:47 -- nvmf/common.sh@295 -- # net_devs=() 00:20:40.860 00:54:47 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:40.860 00:54:47 -- nvmf/common.sh@296 -- # e810=() 00:20:40.860 00:54:47 -- nvmf/common.sh@296 -- # local -ga e810 00:20:40.860 00:54:47 -- nvmf/common.sh@297 -- # x722=() 00:20:40.860 00:54:47 -- nvmf/common.sh@297 -- # local -ga x722 00:20:40.860 00:54:47 -- nvmf/common.sh@298 -- # mlx=() 00:20:40.860 00:54:47 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:40.860 00:54:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:40.860 00:54:47 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:40.860 00:54:47 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:40.860 00:54:47 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:40.860 00:54:47 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:40.860 00:54:47 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:40.860 00:54:47 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:40.860 00:54:47 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:40.860 00:54:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:40.861 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:40.861 00:54:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:40.861 00:54:47 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:40.861 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:40.861 00:54:47 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:40.861 00:54:47 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:40.861 00:54:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:40.861 00:54:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:40.861 Found net devices under 0000:18:00.0: mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:40.861 00:54:47 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:40.861 00:54:47 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:40.861 00:54:47 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:40.861 Found net devices under 0000:18:00.1: mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:40.861 00:54:47 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:40.861 00:54:47 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:40.861 00:54:47 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:40.861 00:54:47 -- nvmf/common.sh@58 -- # uname 00:20:40.861 00:54:47 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:40.861 00:54:47 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:40.861 00:54:47 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:40.861 00:54:47 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:40.861 00:54:47 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:40.861 00:54:47 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:40.861 00:54:47 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:40.861 00:54:47 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:40.861 00:54:47 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:40.861 00:54:47 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:40.861 00:54:47 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:40.861 00:54:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:40.861 00:54:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:40.861 00:54:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:40.861 00:54:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:40.861 00:54:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@105 -- # continue 2 00:20:40.861 00:54:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@105 -- # continue 2 00:20:40.861 00:54:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:40.861 00:54:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:40.861 00:54:47 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:40.861 00:54:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:40.861 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:40.861 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:20:40.861 altname enp24s0f0np0 00:20:40.861 altname ens785f0np0 00:20:40.861 inet 192.168.100.8/24 scope global mlx_0_0 00:20:40.861 valid_lft forever preferred_lft forever 00:20:40.861 00:54:47 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:40.861 00:54:47 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:40.861 00:54:47 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:40.861 00:54:47 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:40.861 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:40.861 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:20:40.861 altname enp24s0f1np1 00:20:40.861 altname ens785f1np1 00:20:40.861 inet 192.168.100.9/24 scope global mlx_0_1 00:20:40.861 valid_lft forever preferred_lft forever 00:20:40.861 00:54:47 -- nvmf/common.sh@411 -- # return 0 00:20:40.861 00:54:47 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:40.861 00:54:47 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:40.861 00:54:47 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:40.861 00:54:47 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:40.861 00:54:47 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:40.861 00:54:47 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:40.861 00:54:47 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:40.861 00:54:47 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:40.861 00:54:47 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:40.861 00:54:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@105 -- # continue 2 00:20:40.861 00:54:47 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:40.861 00:54:47 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:40.861 00:54:47 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:40.861 00:54:47 -- nvmf/common.sh@105 -- # continue 2 00:20:40.861 00:54:47 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:40.861 00:54:47 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:40.861 00:54:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:40.861 00:54:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:40.861 00:54:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:40.861 00:54:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:40.861 00:54:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:40.861 00:54:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:40.861 00:54:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:40.861 00:54:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:40.861 192.168.100.9' 00:20:40.861 00:54:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:40.861 192.168.100.9' 00:20:40.861 00:54:48 -- nvmf/common.sh@446 -- # head -n 1 00:20:40.861 00:54:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:40.861 00:54:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:40.861 192.168.100.9' 00:20:40.861 00:54:48 -- nvmf/common.sh@447 -- # head -n 1 00:20:40.861 00:54:48 -- nvmf/common.sh@447 -- # tail -n +2 00:20:40.861 00:54:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:40.861 00:54:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:40.861 00:54:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:40.861 00:54:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:40.861 00:54:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:40.861 00:54:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:41.122 00:54:48 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:20:41.122 00:54:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:41.122 00:54:48 -- common/autotest_common.sh@710 -- # xtrace_disable 00:20:41.122 00:54:48 -- common/autotest_common.sh@10 -- # set +x 00:20:41.122 00:54:48 -- nvmf/common.sh@470 -- # nvmfpid=359928 00:20:41.122 00:54:48 -- nvmf/common.sh@471 -- # waitforlisten 359928 00:20:41.122 00:54:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:41.122 00:54:48 -- common/autotest_common.sh@817 -- # '[' -z 359928 ']' 00:20:41.122 00:54:48 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:41.122 00:54:48 -- common/autotest_common.sh@822 -- # local max_retries=100 00:20:41.122 00:54:48 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:41.122 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:41.122 00:54:48 -- common/autotest_common.sh@826 -- # xtrace_disable 00:20:41.122 00:54:48 -- common/autotest_common.sh@10 -- # set +x 00:20:41.122 [2024-04-26 00:54:48.103749] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:20:41.122 [2024-04-26 00:54:48.103798] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:41.122 EAL: No free 2048 kB hugepages reported on node 1 00:20:41.122 [2024-04-26 00:54:48.154001] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:41.122 [2024-04-26 00:54:48.224973] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:41.122 [2024-04-26 00:54:48.225011] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:41.122 [2024-04-26 00:54:48.225017] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:41.122 [2024-04-26 00:54:48.225024] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:41.122 [2024-04-26 00:54:48.225028] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:41.122 [2024-04-26 00:54:48.225116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:41.122 [2024-04-26 00:54:48.225207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.122 [2024-04-26 00:54:48.225272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:41.122 [2024-04-26 00:54:48.225276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:42.061 00:54:48 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:20:42.061 00:54:48 -- common/autotest_common.sh@850 -- # return 0 00:20:42.061 00:54:48 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:42.061 00:54:48 -- common/autotest_common.sh@716 -- # xtrace_disable 00:20:42.061 00:54:48 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 00:54:48 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:42.061 00:54:48 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:42.061 00:54:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:48 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 [2024-04-26 00:54:48.955296] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xa18880/0xa1cd70) succeed. 00:20:42.061 [2024-04-26 00:54:48.964414] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa19ec0/0xa5e400) succeed. 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@21 -- # seq 1 11 00:20:42.061 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.061 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:42.061 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 Malloc1 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:20:42.061 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:42.061 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:42.061 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 [2024-04-26 00:54:49.122595] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.061 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:20:42.061 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.061 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.061 Malloc2 00:20:42.061 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.061 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.062 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 Malloc3 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.062 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 Malloc4 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.062 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.062 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.062 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:20:42.062 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.062 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc5 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.323 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc6 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.323 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc7 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.323 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc8 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.323 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc9 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.323 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 Malloc10 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.323 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.323 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t rdma -a 192.168.100.8 -s 4420 00:20:42.323 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.323 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.583 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.583 00:54:49 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.583 00:54:49 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:20:42.583 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.583 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.583 Malloc11 00:20:42.584 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.584 00:54:49 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:20:42.584 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.584 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.584 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.584 00:54:49 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:20:42.584 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.584 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.584 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.584 00:54:49 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t rdma -a 192.168.100.8 -s 4420 00:20:42.584 00:54:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:20:42.584 00:54:49 -- common/autotest_common.sh@10 -- # set +x 00:20:42.584 00:54:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:20:42.584 00:54:49 -- target/multiconnection.sh@28 -- # seq 1 11 00:20:42.584 00:54:49 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:42.584 00:54:49 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:20:43.524 00:54:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:20:43.524 00:54:50 -- common/autotest_common.sh@1184 -- # local i=0 00:20:43.524 00:54:50 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:43.524 00:54:50 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:43.524 00:54:50 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:45.432 00:54:52 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:45.432 00:54:52 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:45.432 00:54:52 -- common/autotest_common.sh@1193 -- # grep -c SPDK1 00:20:45.432 00:54:52 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:45.432 00:54:52 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:45.432 00:54:52 -- common/autotest_common.sh@1194 -- # return 0 00:20:45.432 00:54:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:45.432 00:54:52 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:20:46.367 00:54:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:20:46.367 00:54:53 -- common/autotest_common.sh@1184 -- # local i=0 00:20:46.367 00:54:53 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:46.367 00:54:53 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:46.367 00:54:53 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:48.904 00:54:55 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:48.904 00:54:55 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:48.904 00:54:55 -- common/autotest_common.sh@1193 -- # grep -c SPDK2 00:20:48.904 00:54:55 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:48.904 00:54:55 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:48.904 00:54:55 -- common/autotest_common.sh@1194 -- # return 0 00:20:48.904 00:54:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:48.904 00:54:55 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:20:49.473 00:54:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:20:49.473 00:54:56 -- common/autotest_common.sh@1184 -- # local i=0 00:20:49.473 00:54:56 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:49.473 00:54:56 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:49.473 00:54:56 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:51.379 00:54:58 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:51.379 00:54:58 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:51.379 00:54:58 -- common/autotest_common.sh@1193 -- # grep -c SPDK3 00:20:51.379 00:54:58 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:51.379 00:54:58 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:51.379 00:54:58 -- common/autotest_common.sh@1194 -- # return 0 00:20:51.379 00:54:58 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:51.379 00:54:58 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:20:52.316 00:54:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:20:52.316 00:54:59 -- common/autotest_common.sh@1184 -- # local i=0 00:20:52.316 00:54:59 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:52.316 00:54:59 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:52.316 00:54:59 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:54.855 00:55:01 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:54.855 00:55:01 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:54.856 00:55:01 -- common/autotest_common.sh@1193 -- # grep -c SPDK4 00:20:54.856 00:55:01 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:54.856 00:55:01 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:54.856 00:55:01 -- common/autotest_common.sh@1194 -- # return 0 00:20:54.856 00:55:01 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:54.856 00:55:01 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:20:55.425 00:55:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:20:55.425 00:55:02 -- common/autotest_common.sh@1184 -- # local i=0 00:20:55.425 00:55:02 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:55.425 00:55:02 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:55.425 00:55:02 -- common/autotest_common.sh@1191 -- # sleep 2 00:20:57.330 00:55:04 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:20:57.330 00:55:04 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:20:57.330 00:55:04 -- common/autotest_common.sh@1193 -- # grep -c SPDK5 00:20:57.330 00:55:04 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:20:57.330 00:55:04 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:20:57.330 00:55:04 -- common/autotest_common.sh@1194 -- # return 0 00:20:57.330 00:55:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:57.330 00:55:04 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode6 -a 192.168.100.8 -s 4420 00:20:58.717 00:55:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:20:58.717 00:55:05 -- common/autotest_common.sh@1184 -- # local i=0 00:20:58.717 00:55:05 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:20:58.717 00:55:05 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:20:58.717 00:55:05 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:00.621 00:55:07 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:00.621 00:55:07 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:00.621 00:55:07 -- common/autotest_common.sh@1193 -- # grep -c SPDK6 00:21:00.621 00:55:07 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:00.621 00:55:07 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:00.621 00:55:07 -- common/autotest_common.sh@1194 -- # return 0 00:21:00.621 00:55:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:00.621 00:55:07 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode7 -a 192.168.100.8 -s 4420 00:21:01.558 00:55:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:21:01.558 00:55:08 -- common/autotest_common.sh@1184 -- # local i=0 00:21:01.558 00:55:08 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:01.558 00:55:08 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:01.558 00:55:08 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:03.465 00:55:10 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:03.466 00:55:10 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:03.466 00:55:10 -- common/autotest_common.sh@1193 -- # grep -c SPDK7 00:21:03.466 00:55:10 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:03.466 00:55:10 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:03.466 00:55:10 -- common/autotest_common.sh@1194 -- # return 0 00:21:03.466 00:55:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:03.466 00:55:10 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode8 -a 192.168.100.8 -s 4420 00:21:04.406 00:55:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:21:04.406 00:55:11 -- common/autotest_common.sh@1184 -- # local i=0 00:21:04.406 00:55:11 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:04.406 00:55:11 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:04.406 00:55:11 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:06.309 00:55:13 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:06.309 00:55:13 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:06.309 00:55:13 -- common/autotest_common.sh@1193 -- # grep -c SPDK8 00:21:06.309 00:55:13 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:06.309 00:55:13 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:06.309 00:55:13 -- common/autotest_common.sh@1194 -- # return 0 00:21:06.309 00:55:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:06.309 00:55:13 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode9 -a 192.168.100.8 -s 4420 00:21:07.246 00:55:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:21:07.246 00:55:14 -- common/autotest_common.sh@1184 -- # local i=0 00:21:07.246 00:55:14 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:07.246 00:55:14 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:07.246 00:55:14 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:09.783 00:55:16 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:09.783 00:55:16 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:09.783 00:55:16 -- common/autotest_common.sh@1193 -- # grep -c SPDK9 00:21:09.783 00:55:16 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:09.783 00:55:16 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:09.783 00:55:16 -- common/autotest_common.sh@1194 -- # return 0 00:21:09.783 00:55:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:09.783 00:55:16 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode10 -a 192.168.100.8 -s 4420 00:21:10.352 00:55:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:21:10.352 00:55:17 -- common/autotest_common.sh@1184 -- # local i=0 00:21:10.352 00:55:17 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:10.352 00:55:17 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:10.352 00:55:17 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:12.259 00:55:19 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:12.259 00:55:19 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:12.259 00:55:19 -- common/autotest_common.sh@1193 -- # grep -c SPDK10 00:21:12.518 00:55:19 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:12.518 00:55:19 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:12.518 00:55:19 -- common/autotest_common.sh@1194 -- # return 0 00:21:12.518 00:55:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:12.518 00:55:19 -- target/multiconnection.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode11 -a 192.168.100.8 -s 4420 00:21:13.456 00:55:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:21:13.456 00:55:20 -- common/autotest_common.sh@1184 -- # local i=0 00:21:13.456 00:55:20 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:13.456 00:55:20 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:13.456 00:55:20 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:15.363 00:55:22 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:15.363 00:55:22 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:15.363 00:55:22 -- common/autotest_common.sh@1193 -- # grep -c SPDK11 00:21:15.363 00:55:22 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:15.363 00:55:22 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:15.363 00:55:22 -- common/autotest_common.sh@1194 -- # return 0 00:21:15.363 00:55:22 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:21:15.363 [global] 00:21:15.363 thread=1 00:21:15.363 invalidate=1 00:21:15.363 rw=read 00:21:15.363 time_based=1 00:21:15.363 runtime=10 00:21:15.363 ioengine=libaio 00:21:15.363 direct=1 00:21:15.363 bs=262144 00:21:15.363 iodepth=64 00:21:15.363 norandommap=1 00:21:15.363 numjobs=1 00:21:15.363 00:21:15.363 [job0] 00:21:15.363 filename=/dev/nvme0n1 00:21:15.363 [job1] 00:21:15.363 filename=/dev/nvme10n1 00:21:15.363 [job2] 00:21:15.363 filename=/dev/nvme1n1 00:21:15.363 [job3] 00:21:15.363 filename=/dev/nvme2n1 00:21:15.363 [job4] 00:21:15.363 filename=/dev/nvme3n1 00:21:15.363 [job5] 00:21:15.363 filename=/dev/nvme4n1 00:21:15.363 [job6] 00:21:15.363 filename=/dev/nvme5n1 00:21:15.363 [job7] 00:21:15.363 filename=/dev/nvme6n1 00:21:15.363 [job8] 00:21:15.363 filename=/dev/nvme7n1 00:21:15.363 [job9] 00:21:15.363 filename=/dev/nvme8n1 00:21:15.363 [job10] 00:21:15.363 filename=/dev/nvme9n1 00:21:15.623 Could not set queue depth (nvme0n1) 00:21:15.623 Could not set queue depth (nvme10n1) 00:21:15.623 Could not set queue depth (nvme1n1) 00:21:15.623 Could not set queue depth (nvme2n1) 00:21:15.623 Could not set queue depth (nvme3n1) 00:21:15.623 Could not set queue depth (nvme4n1) 00:21:15.623 Could not set queue depth (nvme5n1) 00:21:15.623 Could not set queue depth (nvme6n1) 00:21:15.623 Could not set queue depth (nvme7n1) 00:21:15.623 Could not set queue depth (nvme8n1) 00:21:15.623 Could not set queue depth (nvme9n1) 00:21:15.882 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:15.882 fio-3.35 00:21:15.882 Starting 11 threads 00:21:28.117 00:21:28.117 job0: (groupid=0, jobs=1): err= 0: pid=366633: Fri Apr 26 00:55:33 2024 00:21:28.117 read: IOPS=1421, BW=355MiB/s (373MB/s)(3573MiB/10050msec) 00:21:28.117 slat (usec): min=7, max=59165, avg=661.43, stdev=2198.10 00:21:28.117 clat (usec): min=836, max=110537, avg=44304.31, stdev=19609.18 00:21:28.117 lat (usec): min=883, max=131902, avg=44965.74, stdev=19980.71 00:21:28.117 clat percentiles (msec): 00:21:28.117 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 29], 00:21:28.117 | 30.00th=[ 33], 40.00th=[ 42], 50.00th=[ 45], 60.00th=[ 47], 00:21:28.117 | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 73], 95.00th=[ 78], 00:21:28.117 | 99.00th=[ 91], 99.50th=[ 95], 99.90th=[ 107], 99.95th=[ 109], 00:21:28.117 | 99.99th=[ 111] 00:21:28.117 bw ( KiB/s): min=203264, max=900096, per=9.08%, avg=364158.85, stdev=153558.00, samples=20 00:21:28.117 iops : min= 794, max= 3516, avg=1422.45, stdev=599.82, samples=20 00:21:28.117 lat (usec) : 1000=0.01% 00:21:28.117 lat (msec) : 2=0.08%, 4=0.92%, 10=1.65%, 20=9.97%, 50=55.99% 00:21:28.117 lat (msec) : 100=31.22%, 250=0.17% 00:21:28.117 cpu : usr=0.34%, sys=3.64%, ctx=3661, majf=0, minf=4097 00:21:28.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:28.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.117 issued rwts: total=14291,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.117 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.117 job1: (groupid=0, jobs=1): err= 0: pid=366634: Fri Apr 26 00:55:33 2024 00:21:28.117 read: IOPS=1258, BW=315MiB/s (330MB/s)(3162MiB/10050msec) 00:21:28.117 slat (usec): min=7, max=25467, avg=786.45, stdev=2112.14 00:21:28.117 clat (msec): min=8, max=115, avg=50.03, stdev=15.97 00:21:28.117 lat (msec): min=9, max=115, avg=50.81, stdev=16.29 00:21:28.117 clat percentiles (msec): 00:21:28.117 | 1.00th=[ 27], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 35], 00:21:28.117 | 30.00th=[ 42], 40.00th=[ 45], 50.00th=[ 47], 60.00th=[ 51], 00:21:28.117 | 70.00th=[ 58], 80.00th=[ 66], 90.00th=[ 74], 95.00th=[ 78], 00:21:28.117 | 99.00th=[ 92], 99.50th=[ 94], 99.90th=[ 104], 99.95th=[ 107], 00:21:28.117 | 99.99th=[ 115] 00:21:28.117 bw ( KiB/s): min=206848, max=535040, per=8.03%, avg=322126.05, stdev=81399.00, samples=20 00:21:28.117 iops : min= 808, max= 2090, avg=1258.25, stdev=317.92, samples=20 00:21:28.117 lat (msec) : 10=0.07%, 20=0.41%, 50=59.51%, 100=39.83%, 250=0.17% 00:21:28.117 cpu : usr=0.29%, sys=3.20%, ctx=2624, majf=0, minf=4097 00:21:28.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:28.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.117 issued rwts: total=12648,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.117 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.117 job2: (groupid=0, jobs=1): err= 0: pid=366635: Fri Apr 26 00:55:33 2024 00:21:28.117 read: IOPS=1864, BW=466MiB/s (489MB/s)(4674MiB/10026msec) 00:21:28.117 slat (usec): min=7, max=60006, avg=448.37, stdev=1797.11 00:21:28.117 clat (usec): min=915, max=150239, avg=33849.32, stdev=19153.01 00:21:28.117 lat (usec): min=944, max=150269, avg=34297.69, stdev=19471.63 00:21:28.117 clat percentiles (msec): 00:21:28.117 | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 16], 00:21:28.117 | 30.00th=[ 18], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], 00:21:28.117 | 70.00th=[ 43], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 74], 00:21:28.117 | 99.00th=[ 90], 99.50th=[ 94], 99.90th=[ 104], 99.95th=[ 118], 00:21:28.117 | 99.99th=[ 150] 00:21:28.117 bw ( KiB/s): min=195584, max=1062400, per=11.89%, avg=476877.10, stdev=245575.57, samples=20 00:21:28.117 iops : min= 764, max= 4150, avg=1862.75, stdev=959.28, samples=20 00:21:28.117 lat (usec) : 1000=0.02% 00:21:28.117 lat (msec) : 2=0.18%, 4=0.29%, 10=0.63%, 20=31.41%, 50=51.30% 00:21:28.117 lat (msec) : 100=15.93%, 250=0.24% 00:21:28.117 cpu : usr=0.32%, sys=3.82%, ctx=5910, majf=0, minf=4097 00:21:28.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:28.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.117 issued rwts: total=18695,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.117 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.117 job3: (groupid=0, jobs=1): err= 0: pid=366636: Fri Apr 26 00:55:33 2024 00:21:28.117 read: IOPS=1346, BW=337MiB/s (353MB/s)(3383MiB/10050msec) 00:21:28.117 slat (usec): min=7, max=55026, avg=668.25, stdev=2470.31 00:21:28.117 clat (usec): min=235, max=133172, avg=46826.03, stdev=24547.60 00:21:28.117 lat (usec): min=254, max=140399, avg=47494.28, stdev=25000.84 00:21:28.117 clat percentiles (msec): 00:21:28.117 | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 26], 00:21:28.117 | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 44], 60.00th=[ 48], 00:21:28.117 | 70.00th=[ 61], 80.00th=[ 71], 90.00th=[ 86], 95.00th=[ 93], 00:21:28.117 | 99.00th=[ 104], 99.50th=[ 106], 99.90th=[ 123], 99.95th=[ 129], 00:21:28.117 | 99.99th=[ 133] 00:21:28.117 bw ( KiB/s): min=178842, max=748544, per=8.60%, avg=344729.90, stdev=161294.17, samples=20 00:21:28.117 iops : min= 698, max= 2924, avg=1346.55, stdev=630.09, samples=20 00:21:28.117 lat (usec) : 250=0.01%, 500=0.02%, 750=0.01%, 1000=0.03% 00:21:28.117 lat (msec) : 2=0.18%, 4=0.14%, 10=0.04%, 20=14.17%, 50=48.88% 00:21:28.117 lat (msec) : 100=34.86%, 250=1.66% 00:21:28.117 cpu : usr=0.26%, sys=3.30%, ctx=3785, majf=0, minf=3221 00:21:28.117 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:28.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.117 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.117 issued rwts: total=13531,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.117 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.117 job4: (groupid=0, jobs=1): err= 0: pid=366637: Fri Apr 26 00:55:33 2024 00:21:28.117 read: IOPS=1903, BW=476MiB/s (499MB/s)(4765MiB/10014msec) 00:21:28.117 slat (usec): min=7, max=64831, avg=466.68, stdev=2356.94 00:21:28.118 clat (usec): min=1156, max=153614, avg=33126.08, stdev=23245.61 00:21:28.118 lat (usec): min=1205, max=159437, avg=33592.76, stdev=23647.58 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 5], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 15], 00:21:28.118 | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 28], 60.00th=[ 31], 00:21:28.118 | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 87], 00:21:28.118 | 99.00th=[ 99], 99.50th=[ 103], 99.90th=[ 121], 99.95th=[ 142], 00:21:28.118 | 99.99th=[ 155] 00:21:28.118 bw ( KiB/s): min=180736, max=1054720, per=12.12%, avg=486288.05, stdev=240954.58, samples=20 00:21:28.118 iops : min= 706, max= 4120, avg=1899.55, stdev=941.24, samples=20 00:21:28.118 lat (msec) : 2=0.31%, 4=0.68%, 10=2.44%, 20=36.31%, 50=42.21% 00:21:28.118 lat (msec) : 100=17.27%, 250=0.78% 00:21:28.118 cpu : usr=0.34%, sys=3.84%, ctx=5464, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=19061,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job5: (groupid=0, jobs=1): err= 0: pid=366638: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1122, BW=281MiB/s (294MB/s)(2819MiB/10048msec) 00:21:28.118 slat (usec): min=7, max=65378, avg=731.32, stdev=3158.37 00:21:28.118 clat (msec): min=10, max=155, avg=56.27, stdev=22.31 00:21:28.118 lat (msec): min=10, max=163, avg=57.00, stdev=22.81 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], 00:21:28.118 | 30.00th=[ 43], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 62], 00:21:28.118 | 70.00th=[ 71], 80.00th=[ 78], 90.00th=[ 88], 95.00th=[ 94], 00:21:28.118 | 99.00th=[ 104], 99.50th=[ 107], 99.90th=[ 126], 99.95th=[ 142], 00:21:28.118 | 99.99th=[ 146] 00:21:28.118 bw ( KiB/s): min=163328, max=476672, per=7.15%, avg=286923.10, stdev=91490.24, samples=20 00:21:28.118 iops : min= 638, max= 1862, avg=1120.75, stdev=357.40, samples=20 00:21:28.118 lat (msec) : 20=1.34%, 50=44.31%, 100=52.00%, 250=2.35% 00:21:28.118 cpu : usr=0.28%, sys=2.85%, ctx=4001, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=11274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job6: (groupid=0, jobs=1): err= 0: pid=366639: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1257, BW=314MiB/s (330MB/s)(3160MiB/10051msec) 00:21:28.118 slat (usec): min=7, max=56973, avg=747.14, stdev=2905.97 00:21:28.118 clat (usec): min=1005, max=154202, avg=50106.16, stdev=24377.62 00:21:28.118 lat (usec): min=1020, max=154237, avg=50853.30, stdev=24864.14 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 5], 5.00th=[ 11], 10.00th=[ 18], 20.00th=[ 30], 00:21:28.118 | 30.00th=[ 33], 40.00th=[ 44], 50.00th=[ 48], 60.00th=[ 57], 00:21:28.118 | 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 85], 95.00th=[ 93], 00:21:28.118 | 99.00th=[ 104], 99.50th=[ 105], 99.90th=[ 131], 99.95th=[ 144], 00:21:28.118 | 99.99th=[ 155] 00:21:28.118 bw ( KiB/s): min=183808, max=632320, per=8.03%, avg=321880.60, stdev=127943.49, samples=20 00:21:28.118 iops : min= 718, max= 2470, avg=1257.30, stdev=499.83, samples=20 00:21:28.118 lat (msec) : 2=0.33%, 4=0.60%, 10=2.21%, 20=9.29%, 50=41.00% 00:21:28.118 lat (msec) : 100=45.15%, 250=1.42% 00:21:28.118 cpu : usr=0.25%, sys=3.04%, ctx=3563, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=12638,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job7: (groupid=0, jobs=1): err= 0: pid=366640: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1317, BW=329MiB/s (345MB/s)(3309MiB/10050msec) 00:21:28.118 slat (usec): min=7, max=52138, avg=691.70, stdev=2655.65 00:21:28.118 clat (usec): min=1347, max=135360, avg=47861.38, stdev=25071.48 00:21:28.118 lat (usec): min=1362, max=140463, avg=48553.09, stdev=25534.86 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 3], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 27], 00:21:28.118 | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 56], 00:21:28.118 | 70.00th=[ 63], 80.00th=[ 73], 90.00th=[ 82], 95.00th=[ 90], 00:21:28.118 | 99.00th=[ 103], 99.50th=[ 105], 99.90th=[ 124], 99.95th=[ 133], 00:21:28.118 | 99.99th=[ 136] 00:21:28.118 bw ( KiB/s): min=193024, max=731648, per=8.41%, avg=337179.90, stdev=148850.79, samples=20 00:21:28.118 iops : min= 754, max= 2858, avg=1317.05, stdev=581.48, samples=20 00:21:28.118 lat (msec) : 2=0.45%, 4=1.20%, 10=2.76%, 20=12.64%, 50=38.04% 00:21:28.118 lat (msec) : 100=43.63%, 250=1.28% 00:21:28.118 cpu : usr=0.29%, sys=2.99%, ctx=4086, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=13236,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job8: (groupid=0, jobs=1): err= 0: pid=366641: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1401, BW=350MiB/s (367MB/s)(3513MiB/10029msec) 00:21:28.118 slat (usec): min=7, max=40885, avg=667.60, stdev=2024.84 00:21:28.118 clat (usec): min=1295, max=104819, avg=44968.98, stdev=17251.84 00:21:28.118 lat (usec): min=1333, max=110858, avg=45636.58, stdev=17579.06 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 9], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 31], 00:21:28.118 | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 43], 60.00th=[ 46], 00:21:28.118 | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 73], 95.00th=[ 78], 00:21:28.118 | 99.00th=[ 91], 99.50th=[ 93], 99.90th=[ 97], 99.95th=[ 99], 00:21:28.118 | 99.99th=[ 105] 00:21:28.118 bw ( KiB/s): min=207872, max=541184, per=8.93%, avg=358032.15, stdev=94050.37, samples=20 00:21:28.118 iops : min= 812, max= 2114, avg=1398.50, stdev=367.33, samples=20 00:21:28.118 lat (msec) : 2=0.08%, 4=0.18%, 10=0.92%, 20=2.46%, 50=67.31% 00:21:28.118 lat (msec) : 100=29.01%, 250=0.04% 00:21:28.118 cpu : usr=0.34%, sys=3.18%, ctx=3714, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=14052,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job9: (groupid=0, jobs=1): err= 0: pid=366642: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1067, BW=267MiB/s (280MB/s)(2683MiB/10049msec) 00:21:28.118 slat (usec): min=7, max=65372, avg=815.54, stdev=2780.00 00:21:28.118 clat (msec): min=11, max=163, avg=59.07, stdev=21.24 00:21:28.118 lat (msec): min=11, max=163, avg=59.89, stdev=21.63 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 37], 00:21:28.118 | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 60], 60.00th=[ 66], 00:21:28.118 | 70.00th=[ 73], 80.00th=[ 79], 90.00th=[ 89], 95.00th=[ 94], 00:21:28.118 | 99.00th=[ 104], 99.50th=[ 105], 99.90th=[ 130], 99.95th=[ 132], 00:21:28.118 | 99.99th=[ 163] 00:21:28.118 bw ( KiB/s): min=180736, max=470016, per=6.81%, avg=273006.90, stdev=83283.27, samples=20 00:21:28.118 iops : min= 706, max= 1836, avg=1066.40, stdev=325.30, samples=20 00:21:28.118 lat (msec) : 20=0.50%, 50=37.39%, 100=60.04%, 250=2.07% 00:21:28.118 cpu : usr=0.25%, sys=2.80%, ctx=3086, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=10730,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 job10: (groupid=0, jobs=1): err= 0: pid=366643: Fri Apr 26 00:55:33 2024 00:21:28.118 read: IOPS=1722, BW=431MiB/s (452MB/s)(4328MiB/10050msec) 00:21:28.118 slat (usec): min=7, max=73492, avg=457.66, stdev=2068.66 00:21:28.118 clat (usec): min=475, max=141851, avg=36665.42, stdev=23783.65 00:21:28.118 lat (usec): min=491, max=164224, avg=37123.08, stdev=24130.94 00:21:28.118 clat percentiles (msec): 00:21:28.118 | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 13], 20.00th=[ 16], 00:21:28.118 | 30.00th=[ 20], 40.00th=[ 29], 50.00th=[ 31], 60.00th=[ 40], 00:21:28.118 | 70.00th=[ 46], 80.00th=[ 56], 90.00th=[ 77], 95.00th=[ 87], 00:21:28.118 | 99.00th=[ 99], 99.50th=[ 102], 99.90th=[ 108], 99.95th=[ 121], 00:21:28.118 | 99.99th=[ 142] 00:21:28.118 bw ( KiB/s): min=179200, max=780800, per=11.01%, avg=441481.85, stdev=165900.15, samples=20 00:21:28.118 iops : min= 700, max= 3050, avg=1724.50, stdev=648.07, samples=20 00:21:28.118 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.05% 00:21:28.118 lat (msec) : 2=0.84%, 4=1.77%, 10=6.03%, 20=22.01%, 50=45.52% 00:21:28.118 lat (msec) : 100=23.05%, 250=0.70% 00:21:28.118 cpu : usr=0.38%, sys=3.99%, ctx=6549, majf=0, minf=4097 00:21:28.118 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.6% 00:21:28.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:28.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:28.118 issued rwts: total=17311,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:28.118 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:28.118 00:21:28.118 Run status group 0 (all jobs): 00:21:28.118 READ: bw=3917MiB/s (4107MB/s), 267MiB/s-476MiB/s (280MB/s-499MB/s), io=38.4GiB (41.3GB), run=10014-10051msec 00:21:28.118 00:21:28.118 Disk stats (read/write): 00:21:28.118 nvme0n1: ios=28194/0, merge=0/0, ticks=1220411/0, in_queue=1220411, util=96.66% 00:21:28.118 nvme10n1: ios=24893/0, merge=0/0, ticks=1217758/0, in_queue=1217758, util=96.89% 00:21:28.118 nvme1n1: ios=36783/0, merge=0/0, ticks=1222931/0, in_queue=1222931, util=97.23% 00:21:28.118 nvme2n1: ios=26682/0, merge=0/0, ticks=1222668/0, in_queue=1222668, util=97.46% 00:21:28.119 nvme3n1: ios=37010/0, merge=0/0, ticks=1221856/0, in_queue=1221856, util=97.54% 00:21:28.119 nvme4n1: ios=22181/0, merge=0/0, ticks=1223389/0, in_queue=1223389, util=97.95% 00:21:28.119 nvme5n1: ios=24963/0, merge=0/0, ticks=1218368/0, in_queue=1218368, util=98.15% 00:21:28.119 nvme6n1: ios=26083/0, merge=0/0, ticks=1217915/0, in_queue=1217915, util=98.30% 00:21:28.119 nvme7n1: ios=27496/0, merge=0/0, ticks=1220197/0, in_queue=1220197, util=98.81% 00:21:28.119 nvme8n1: ios=21114/0, merge=0/0, ticks=1221969/0, in_queue=1221969, util=99.04% 00:21:28.119 nvme9n1: ios=34261/0, merge=0/0, ticks=1222875/0, in_queue=1222875, util=99.22% 00:21:28.119 00:55:33 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:21:28.119 [global] 00:21:28.119 thread=1 00:21:28.119 invalidate=1 00:21:28.119 rw=randwrite 00:21:28.119 time_based=1 00:21:28.119 runtime=10 00:21:28.119 ioengine=libaio 00:21:28.119 direct=1 00:21:28.119 bs=262144 00:21:28.119 iodepth=64 00:21:28.119 norandommap=1 00:21:28.119 numjobs=1 00:21:28.119 00:21:28.119 [job0] 00:21:28.119 filename=/dev/nvme0n1 00:21:28.119 [job1] 00:21:28.119 filename=/dev/nvme10n1 00:21:28.119 [job2] 00:21:28.119 filename=/dev/nvme1n1 00:21:28.119 [job3] 00:21:28.119 filename=/dev/nvme2n1 00:21:28.119 [job4] 00:21:28.119 filename=/dev/nvme3n1 00:21:28.119 [job5] 00:21:28.119 filename=/dev/nvme4n1 00:21:28.119 [job6] 00:21:28.119 filename=/dev/nvme5n1 00:21:28.119 [job7] 00:21:28.119 filename=/dev/nvme6n1 00:21:28.119 [job8] 00:21:28.119 filename=/dev/nvme7n1 00:21:28.119 [job9] 00:21:28.119 filename=/dev/nvme8n1 00:21:28.119 [job10] 00:21:28.119 filename=/dev/nvme9n1 00:21:28.119 Could not set queue depth (nvme0n1) 00:21:28.119 Could not set queue depth (nvme10n1) 00:21:28.119 Could not set queue depth (nvme1n1) 00:21:28.119 Could not set queue depth (nvme2n1) 00:21:28.119 Could not set queue depth (nvme3n1) 00:21:28.119 Could not set queue depth (nvme4n1) 00:21:28.119 Could not set queue depth (nvme5n1) 00:21:28.119 Could not set queue depth (nvme6n1) 00:21:28.119 Could not set queue depth (nvme7n1) 00:21:28.119 Could not set queue depth (nvme8n1) 00:21:28.119 Could not set queue depth (nvme9n1) 00:21:28.119 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:28.119 fio-3.35 00:21:28.119 Starting 11 threads 00:21:38.108 00:21:38.108 job0: (groupid=0, jobs=1): err= 0: pid=368359: Fri Apr 26 00:55:44 2024 00:21:38.108 write: IOPS=1002, BW=251MiB/s (263MB/s)(2519MiB/10049msec); 0 zone resets 00:21:38.108 slat (usec): min=14, max=99135, avg=859.60, stdev=3017.24 00:21:38.108 clat (usec): min=633, max=216979, avg=62945.64, stdev=47374.63 00:21:38.108 lat (usec): min=694, max=223935, avg=63805.25, stdev=48043.26 00:21:38.108 clat percentiles (usec): 00:21:38.108 | 1.00th=[ 1549], 5.00th=[ 5342], 10.00th=[ 15926], 20.00th=[ 21365], 00:21:38.108 | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 49021], 60.00th=[ 54264], 00:21:38.108 | 70.00th=[ 95945], 80.00th=[120062], 90.00th=[135267], 95.00th=[143655], 00:21:38.108 | 99.00th=[166724], 99.50th=[183501], 99.90th=[200279], 99.95th=[208667], 00:21:38.108 | 99.99th=[217056] 00:21:38.108 bw ( KiB/s): min=112640, max=671232, per=7.47%, avg=256345.70, stdev=150790.88, samples=20 00:21:38.108 iops : min= 440, max= 2622, avg=1001.35, stdev=589.03, samples=20 00:21:38.108 lat (usec) : 750=0.04%, 1000=0.13% 00:21:38.108 lat (msec) : 2=1.64%, 4=2.15%, 10=4.70%, 20=9.88%, 50=33.89% 00:21:38.108 lat (msec) : 100=19.06%, 250=28.50% 00:21:38.108 cpu : usr=1.82%, sys=2.79%, ctx=3256, majf=0, minf=1 00:21:38.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:38.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.108 issued rwts: total=0,10077,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.108 job1: (groupid=0, jobs=1): err= 0: pid=368373: Fri Apr 26 00:55:44 2024 00:21:38.108 write: IOPS=1180, BW=295MiB/s (309MB/s)(2965MiB/10051msec); 0 zone resets 00:21:38.108 slat (usec): min=10, max=76271, avg=646.83, stdev=2438.95 00:21:38.108 clat (usec): min=253, max=199807, avg=53576.07, stdev=43151.12 00:21:38.108 lat (usec): min=289, max=201997, avg=54222.90, stdev=43691.63 00:21:38.108 clat percentiles (usec): 00:21:38.108 | 1.00th=[ 1270], 5.00th=[ 4883], 10.00th=[ 9503], 20.00th=[ 17695], 00:21:38.108 | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 39584], 60.00th=[ 51119], 00:21:38.108 | 70.00th=[ 56361], 80.00th=[101188], 90.00th=[130548], 95.00th=[139461], 00:21:38.108 | 99.00th=[158335], 99.50th=[164627], 99.90th=[181404], 99.95th=[191890], 00:21:38.108 | 99.99th=[200279] 00:21:38.108 bw ( KiB/s): min=112640, max=658944, per=8.80%, avg=302095.65, stdev=177947.20, samples=20 00:21:38.108 iops : min= 440, max= 2574, avg=1180.00, stdev=695.03, samples=20 00:21:38.108 lat (usec) : 500=0.09%, 750=0.07%, 1000=0.59% 00:21:38.108 lat (msec) : 2=0.84%, 4=2.03%, 10=6.66%, 20=13.51%, 50=34.15% 00:21:38.108 lat (msec) : 100=21.93%, 250=20.12% 00:21:38.108 cpu : usr=2.20%, sys=3.04%, ctx=4048, majf=0, minf=1 00:21:38.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:21:38.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.108 issued rwts: total=0,11861,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.108 job2: (groupid=0, jobs=1): err= 0: pid=368377: Fri Apr 26 00:55:44 2024 00:21:38.108 write: IOPS=613, BW=153MiB/s (161MB/s)(1543MiB/10051msec); 0 zone resets 00:21:38.108 slat (usec): min=18, max=41374, avg=1351.29, stdev=3031.90 00:21:38.108 clat (msec): min=2, max=161, avg=102.86, stdev=30.54 00:21:38.108 lat (msec): min=2, max=165, avg=104.21, stdev=30.88 00:21:38.108 clat percentiles (msec): 00:21:38.108 | 1.00th=[ 7], 5.00th=[ 53], 10.00th=[ 68], 20.00th=[ 78], 00:21:38.108 | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 117], 00:21:38.108 | 70.00th=[ 124], 80.00th=[ 130], 90.00th=[ 138], 95.00th=[ 144], 00:21:38.108 | 99.00th=[ 150], 99.50th=[ 155], 99.90th=[ 159], 99.95th=[ 161], 00:21:38.108 | 99.99th=[ 163] 00:21:38.108 bw ( KiB/s): min=111104, max=229376, per=4.56%, avg=156400.35, stdev=40182.28, samples=20 00:21:38.108 iops : min= 434, max= 896, avg=610.90, stdev=156.90, samples=20 00:21:38.108 lat (msec) : 4=0.11%, 10=1.35%, 20=1.67%, 50=1.57%, 100=37.51% 00:21:38.108 lat (msec) : 250=57.79% 00:21:38.108 cpu : usr=1.28%, sys=1.89%, ctx=1999, majf=0, minf=1 00:21:38.108 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:38.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.108 issued rwts: total=0,6171,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.108 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.108 job3: (groupid=0, jobs=1): err= 0: pid=368382: Fri Apr 26 00:55:44 2024 00:21:38.108 write: IOPS=713, BW=178MiB/s (187MB/s)(1793MiB/10055msec); 0 zone resets 00:21:38.108 slat (usec): min=18, max=62840, avg=1319.46, stdev=3066.31 00:21:38.108 clat (usec): min=685, max=168190, avg=88381.52, stdev=40796.59 00:21:38.108 lat (usec): min=743, max=168245, avg=89700.98, stdev=41434.70 00:21:38.108 clat percentiles (msec): 00:21:38.109 | 1.00th=[ 9], 5.00th=[ 31], 10.00th=[ 33], 20.00th=[ 43], 00:21:38.109 | 30.00th=[ 59], 40.00th=[ 78], 50.00th=[ 92], 60.00th=[ 110], 00:21:38.109 | 70.00th=[ 122], 80.00th=[ 130], 90.00th=[ 140], 95.00th=[ 144], 00:21:38.109 | 99.00th=[ 155], 99.50th=[ 157], 99.90th=[ 161], 99.95th=[ 169], 00:21:38.109 | 99.99th=[ 169] 00:21:38.109 bw ( KiB/s): min=112640, max=468480, per=5.30%, avg=182025.20, stdev=87496.91, samples=20 00:21:38.109 iops : min= 440, max= 1830, avg=710.95, stdev=341.80, samples=20 00:21:38.109 lat (usec) : 750=0.03%, 1000=0.03% 00:21:38.109 lat (msec) : 2=0.32%, 4=0.31%, 10=0.93%, 20=1.35%, 50=23.90% 00:21:38.109 lat (msec) : 100=26.42%, 250=46.71% 00:21:38.109 cpu : usr=1.42%, sys=2.03%, ctx=2039, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,7172,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job4: (groupid=0, jobs=1): err= 0: pid=368384: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=2119, BW=530MiB/s (556MB/s)(5319MiB/10038msec); 0 zone resets 00:21:38.109 slat (usec): min=10, max=30159, avg=416.05, stdev=1249.22 00:21:38.109 clat (usec): min=366, max=111785, avg=29769.76, stdev=18777.11 00:21:38.109 lat (usec): min=403, max=111818, avg=30185.81, stdev=19089.97 00:21:38.109 clat percentiles (usec): 00:21:38.109 | 1.00th=[ 1516], 5.00th=[ 4686], 10.00th=[ 8717], 20.00th=[15139], 00:21:38.109 | 30.00th=[16319], 40.00th=[17433], 50.00th=[23725], 60.00th=[32900], 00:21:38.109 | 70.00th=[40109], 80.00th=[50070], 90.00th=[57934], 95.00th=[62653], 00:21:38.109 | 99.00th=[70779], 99.50th=[74974], 99.90th=[85459], 99.95th=[92799], 00:21:38.109 | 99.99th=[93848] 00:21:38.109 bw ( KiB/s): min=255488, max=1198080, per=15.82%, avg=542968.00, stdev=278543.62, samples=20 00:21:38.109 iops : min= 998, max= 4680, avg=2120.90, stdev=1088.09, samples=20 00:21:38.109 lat (usec) : 500=0.05%, 750=0.14%, 1000=0.20% 00:21:38.109 lat (msec) : 2=1.33%, 4=2.49%, 10=7.24%, 20=35.31%, 50=32.94% 00:21:38.109 lat (msec) : 100=20.30%, 250=0.01% 00:21:38.109 cpu : usr=3.49%, sys=4.83%, ctx=6173, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,21277,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job5: (groupid=0, jobs=1): err= 0: pid=368392: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=1051, BW=263MiB/s (276MB/s)(2641MiB/10040msec); 0 zone resets 00:21:38.109 slat (usec): min=13, max=109761, avg=811.44, stdev=2689.25 00:21:38.109 clat (usec): min=226, max=248059, avg=60008.32, stdev=46404.32 00:21:38.109 lat (usec): min=264, max=248103, avg=60819.76, stdev=47101.31 00:21:38.109 clat percentiles (usec): 00:21:38.109 | 1.00th=[ 1254], 5.00th=[ 3621], 10.00th=[ 8291], 20.00th=[ 16057], 00:21:38.109 | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 47973], 60.00th=[ 61604], 00:21:38.109 | 70.00th=[ 83362], 80.00th=[111674], 90.00th=[131597], 95.00th=[139461], 00:21:38.109 | 99.00th=[154141], 99.50th=[177210], 99.90th=[229639], 99.95th=[246416], 00:21:38.109 | 99.99th=[248513] 00:21:38.109 bw ( KiB/s): min=117760, max=832512, per=7.83%, avg=268855.05, stdev=193243.55, samples=20 00:21:38.109 iops : min= 460, max= 3252, avg=1050.15, stdev=754.81, samples=20 00:21:38.109 lat (usec) : 250=0.03%, 500=0.08%, 750=0.10%, 1000=0.26% 00:21:38.109 lat (msec) : 2=3.20%, 4=1.60%, 10=6.13%, 20=13.04%, 50=26.42% 00:21:38.109 lat (msec) : 100=24.87%, 250=24.28% 00:21:38.109 cpu : usr=1.97%, sys=2.82%, ctx=3629, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,10562,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job6: (groupid=0, jobs=1): err= 0: pid=368397: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=2538, BW=635MiB/s (665MB/s)(6380MiB/10055msec); 0 zone resets 00:21:38.109 slat (usec): min=11, max=41380, avg=317.90, stdev=1082.67 00:21:38.109 clat (usec): min=442, max=117033, avg=24890.01, stdev=17002.19 00:21:38.109 lat (usec): min=539, max=117076, avg=25207.91, stdev=17222.71 00:21:38.109 clat percentiles (usec): 00:21:38.109 | 1.00th=[ 1221], 5.00th=[ 3490], 10.00th=[ 7308], 20.00th=[ 15270], 00:21:38.109 | 30.00th=[ 16450], 40.00th=[ 17171], 50.00th=[ 17957], 60.00th=[ 21365], 00:21:38.109 | 70.00th=[ 30278], 80.00th=[ 34866], 90.00th=[ 50594], 95.00th=[ 61080], 00:21:38.109 | 99.00th=[ 81265], 99.50th=[ 84411], 99.90th=[ 94897], 99.95th=[101188], 00:21:38.109 | 99.99th=[116917] 00:21:38.109 bw ( KiB/s): min=327168, max=947712, per=18.99%, avg=651848.20, stdev=182974.68, samples=20 00:21:38.109 iops : min= 1278, max= 3702, avg=2546.20, stdev=714.77, samples=20 00:21:38.109 lat (usec) : 500=0.01%, 750=0.14%, 1000=0.45% 00:21:38.109 lat (msec) : 2=1.68%, 4=3.96%, 10=6.86%, 20=45.14%, 50=31.48% 00:21:38.109 lat (msec) : 100=10.22%, 250=0.05% 00:21:38.109 cpu : usr=4.03%, sys=5.52%, ctx=7584, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,25521,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job7: (groupid=0, jobs=1): err= 0: pid=368400: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=813, BW=203MiB/s (213MB/s)(2045MiB/10051msec); 0 zone resets 00:21:38.109 slat (usec): min=14, max=69330, avg=998.70, stdev=2933.59 00:21:38.109 clat (usec): min=268, max=204286, avg=77630.85, stdev=43392.73 00:21:38.109 lat (usec): min=318, max=204350, avg=78629.55, stdev=44065.05 00:21:38.109 clat percentiles (msec): 00:21:38.109 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 23], 20.00th=[ 40], 00:21:38.109 | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 66], 60.00th=[ 90], 00:21:38.109 | 70.00th=[ 113], 80.00th=[ 125], 90.00th=[ 138], 95.00th=[ 144], 00:21:38.109 | 99.00th=[ 159], 99.50th=[ 169], 99.90th=[ 194], 99.95th=[ 197], 00:21:38.109 | 99.99th=[ 205] 00:21:38.109 bw ( KiB/s): min=112640, max=423424, per=6.05%, avg=207810.30, stdev=83831.00, samples=20 00:21:38.109 iops : min= 440, max= 1654, avg=811.70, stdev=327.51, samples=20 00:21:38.109 lat (usec) : 500=0.04%, 750=0.04%, 1000=0.11% 00:21:38.109 lat (msec) : 2=0.48%, 4=0.44%, 10=3.99%, 20=3.63%, 50=20.03% 00:21:38.109 lat (msec) : 100=35.13%, 250=36.13% 00:21:38.109 cpu : usr=1.77%, sys=2.27%, ctx=2859, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,8179,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job8: (groupid=0, jobs=1): err= 0: pid=368409: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=805, BW=201MiB/s (211MB/s)(2023MiB/10047msec); 0 zone resets 00:21:38.109 slat (usec): min=20, max=82668, avg=1063.36, stdev=3130.47 00:21:38.109 clat (usec): min=715, max=212531, avg=78377.14, stdev=43670.44 00:21:38.109 lat (usec): min=766, max=212595, avg=79440.50, stdev=44316.58 00:21:38.109 clat percentiles (msec): 00:21:38.109 | 1.00th=[ 3], 5.00th=[ 11], 10.00th=[ 23], 20.00th=[ 45], 00:21:38.109 | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 91], 00:21:38.109 | 70.00th=[ 115], 80.00th=[ 127], 90.00th=[ 138], 95.00th=[ 144], 00:21:38.109 | 99.00th=[ 161], 99.50th=[ 180], 99.90th=[ 201], 99.95th=[ 209], 00:21:38.109 | 99.99th=[ 213] 00:21:38.109 bw ( KiB/s): min=113152, max=386560, per=5.99%, avg=205529.80, stdev=78279.90, samples=20 00:21:38.109 iops : min= 442, max= 1510, avg=802.85, stdev=305.78, samples=20 00:21:38.109 lat (usec) : 750=0.02%, 1000=0.02% 00:21:38.109 lat (msec) : 2=0.62%, 4=0.96%, 10=1.83%, 20=5.41%, 50=18.98% 00:21:38.109 lat (msec) : 100=34.81%, 250=37.33% 00:21:38.109 cpu : usr=1.72%, sys=2.33%, ctx=2661, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,8092,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job9: (groupid=0, jobs=1): err= 0: pid=368414: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=1980, BW=495MiB/s (519MB/s)(4972MiB/10042msec); 0 zone resets 00:21:38.109 slat (usec): min=10, max=108376, avg=376.42, stdev=1591.03 00:21:38.109 clat (usec): min=272, max=236750, avg=31934.17, stdev=29907.39 00:21:38.109 lat (usec): min=293, max=245413, avg=32310.59, stdev=30329.33 00:21:38.109 clat percentiles (usec): 00:21:38.109 | 1.00th=[ 1467], 5.00th=[ 3851], 10.00th=[ 6783], 20.00th=[ 12518], 00:21:38.109 | 30.00th=[ 15270], 40.00th=[ 16909], 50.00th=[ 19530], 60.00th=[ 28705], 00:21:38.109 | 70.00th=[ 33424], 80.00th=[ 50070], 90.00th=[ 61604], 95.00th=[103285], 00:21:38.109 | 99.00th=[139461], 99.50th=[147850], 99.90th=[200279], 99.95th=[214959], 00:21:38.109 | 99.99th=[233833] 00:21:38.109 bw ( KiB/s): min=157696, max=1403904, per=14.78%, avg=507448.25, stdev=354622.96, samples=20 00:21:38.109 iops : min= 616, max= 5484, avg=1982.20, stdev=1385.26, samples=20 00:21:38.109 lat (usec) : 500=0.03%, 750=0.23%, 1000=0.22% 00:21:38.109 lat (msec) : 2=1.39%, 4=3.56%, 10=10.20%, 20=34.95%, 50=29.26% 00:21:38.109 lat (msec) : 100=14.44%, 250=5.72% 00:21:38.109 cpu : usr=3.53%, sys=4.97%, ctx=6460, majf=0, minf=1 00:21:38.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:21:38.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.109 issued rwts: total=0,19886,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.109 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.109 job10: (groupid=0, jobs=1): err= 0: pid=368418: Fri Apr 26 00:55:44 2024 00:21:38.109 write: IOPS=601, BW=150MiB/s (158MB/s)(1512MiB/10056msec); 0 zone resets 00:21:38.109 slat (usec): min=20, max=25332, avg=1635.28, stdev=3219.35 00:21:38.109 clat (msec): min=4, max=158, avg=104.75, stdev=28.82 00:21:38.110 lat (msec): min=4, max=158, avg=106.38, stdev=29.24 00:21:38.110 clat percentiles (msec): 00:21:38.110 | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 65], 20.00th=[ 78], 00:21:38.110 | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 118], 00:21:38.110 | 70.00th=[ 125], 80.00th=[ 132], 90.00th=[ 140], 95.00th=[ 144], 00:21:38.110 | 99.00th=[ 150], 99.50th=[ 153], 99.90th=[ 157], 99.95th=[ 159], 00:21:38.110 | 99.99th=[ 159] 00:21:38.110 bw ( KiB/s): min=112640, max=278528, per=4.46%, avg=153228.70, stdev=44788.66, samples=20 00:21:38.110 iops : min= 440, max= 1088, avg=598.50, stdev=174.99, samples=20 00:21:38.110 lat (msec) : 10=0.15%, 20=0.13%, 50=4.25%, 100=35.90%, 250=59.57% 00:21:38.110 cpu : usr=1.53%, sys=2.29%, ctx=1564, majf=0, minf=1 00:21:38.110 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:38.110 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:38.110 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:38.110 issued rwts: total=0,6048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:38.110 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:38.110 00:21:38.110 Run status group 0 (all jobs): 00:21:38.110 WRITE: bw=3352MiB/s (3515MB/s), 150MiB/s-635MiB/s (158MB/s-665MB/s), io=32.9GiB (35.3GB), run=10038-10056msec 00:21:38.110 00:21:38.110 Disk stats (read/write): 00:21:38.110 nvme0n1: ios=49/19995, merge=0/0, ticks=14/1235524, in_queue=1235538, util=97.75% 00:21:38.110 nvme10n1: ios=13/23592, merge=0/0, ticks=8/1240449, in_queue=1240457, util=97.85% 00:21:38.110 nvme1n1: ios=0/12194, merge=0/0, ticks=0/1233760, in_queue=1233760, util=98.05% 00:21:38.110 nvme2n1: ios=0/14190, merge=0/0, ticks=0/1230702, in_queue=1230702, util=98.15% 00:21:38.110 nvme3n1: ios=0/42430, merge=0/0, ticks=0/1236005, in_queue=1236005, util=98.20% 00:21:38.110 nvme4n1: ios=0/20942, merge=0/0, ticks=0/1231751, in_queue=1231751, util=98.41% 00:21:38.110 nvme5n1: ios=0/50882, merge=0/0, ticks=0/1240281, in_queue=1240281, util=98.51% 00:21:38.110 nvme6n1: ios=0/16208, merge=0/0, ticks=0/1236230, in_queue=1236230, util=98.59% 00:21:38.110 nvme7n1: ios=0/16031, merge=0/0, ticks=0/1232561, in_queue=1232561, util=98.80% 00:21:38.110 nvme8n1: ios=0/39620, merge=0/0, ticks=0/1240103, in_queue=1240103, util=98.99% 00:21:38.110 nvme9n1: ios=0/11953, merge=0/0, ticks=0/1226286, in_queue=1226286, util=99.06% 00:21:38.110 00:55:44 -- target/multiconnection.sh@36 -- # sync 00:21:38.110 00:55:44 -- target/multiconnection.sh@37 -- # seq 1 11 00:21:38.110 00:55:44 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:38.110 00:55:44 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:38.110 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:38.110 00:55:45 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:21:38.110 00:55:45 -- common/autotest_common.sh@1205 -- # local i=0 00:21:38.110 00:55:45 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:38.110 00:55:45 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:21:38.110 00:55:45 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:38.110 00:55:45 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK1 00:21:38.110 00:55:45 -- common/autotest_common.sh@1217 -- # return 0 00:21:38.110 00:55:45 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:38.110 00:55:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:38.110 00:55:45 -- common/autotest_common.sh@10 -- # set +x 00:21:38.110 00:55:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:38.110 00:55:45 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:38.110 00:55:45 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:21:39.052 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:21:39.052 00:55:46 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:21:39.052 00:55:46 -- common/autotest_common.sh@1205 -- # local i=0 00:21:39.052 00:55:46 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:39.052 00:55:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:21:39.052 00:55:46 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK2 00:21:39.052 00:55:46 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:39.312 00:55:46 -- common/autotest_common.sh@1217 -- # return 0 00:21:39.313 00:55:46 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:39.313 00:55:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:39.313 00:55:46 -- common/autotest_common.sh@10 -- # set +x 00:21:39.313 00:55:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:39.313 00:55:46 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:39.313 00:55:46 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:21:40.252 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:21:40.252 00:55:47 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:21:40.252 00:55:47 -- common/autotest_common.sh@1205 -- # local i=0 00:21:40.252 00:55:47 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:40.252 00:55:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:21:40.252 00:55:47 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:40.252 00:55:47 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK3 00:21:40.252 00:55:47 -- common/autotest_common.sh@1217 -- # return 0 00:21:40.252 00:55:47 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:21:40.252 00:55:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:40.252 00:55:47 -- common/autotest_common.sh@10 -- # set +x 00:21:40.252 00:55:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:40.252 00:55:47 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:40.252 00:55:47 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:21:41.191 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:21:41.191 00:55:48 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:21:41.191 00:55:48 -- common/autotest_common.sh@1205 -- # local i=0 00:21:41.191 00:55:48 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:41.191 00:55:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:21:41.191 00:55:48 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:41.191 00:55:48 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK4 00:21:41.191 00:55:48 -- common/autotest_common.sh@1217 -- # return 0 00:21:41.191 00:55:48 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:21:41.191 00:55:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:41.191 00:55:48 -- common/autotest_common.sh@10 -- # set +x 00:21:41.191 00:55:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:41.191 00:55:48 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:41.191 00:55:48 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:21:42.221 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:21:42.221 00:55:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:21:42.221 00:55:49 -- common/autotest_common.sh@1205 -- # local i=0 00:21:42.221 00:55:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:42.221 00:55:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:21:42.221 00:55:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:42.221 00:55:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK5 00:21:42.221 00:55:49 -- common/autotest_common.sh@1217 -- # return 0 00:21:42.221 00:55:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:21:42.221 00:55:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:42.221 00:55:49 -- common/autotest_common.sh@10 -- # set +x 00:21:42.221 00:55:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:42.221 00:55:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:42.221 00:55:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:21:43.202 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:21:43.202 00:55:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:21:43.203 00:55:50 -- common/autotest_common.sh@1205 -- # local i=0 00:21:43.203 00:55:50 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:43.203 00:55:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:21:43.203 00:55:50 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:43.203 00:55:50 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK6 00:21:43.203 00:55:50 -- common/autotest_common.sh@1217 -- # return 0 00:21:43.203 00:55:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:21:43.203 00:55:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:43.203 00:55:50 -- common/autotest_common.sh@10 -- # set +x 00:21:43.203 00:55:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:43.203 00:55:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:43.203 00:55:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:21:44.230 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:21:44.230 00:55:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:21:44.230 00:55:51 -- common/autotest_common.sh@1205 -- # local i=0 00:21:44.230 00:55:51 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:44.230 00:55:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:21:44.231 00:55:51 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:44.231 00:55:51 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK7 00:21:44.231 00:55:51 -- common/autotest_common.sh@1217 -- # return 0 00:21:44.231 00:55:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:21:44.231 00:55:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:44.231 00:55:51 -- common/autotest_common.sh@10 -- # set +x 00:21:44.231 00:55:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:44.231 00:55:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:44.231 00:55:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:21:45.213 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:21:45.213 00:55:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:21:45.213 00:55:52 -- common/autotest_common.sh@1205 -- # local i=0 00:21:45.213 00:55:52 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:45.213 00:55:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:21:45.213 00:55:52 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:45.213 00:55:52 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK8 00:21:45.213 00:55:52 -- common/autotest_common.sh@1217 -- # return 0 00:21:45.213 00:55:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:21:45.213 00:55:52 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:45.213 00:55:52 -- common/autotest_common.sh@10 -- # set +x 00:21:45.213 00:55:52 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:45.213 00:55:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:45.213 00:55:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:21:46.210 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:21:46.210 00:55:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:21:46.210 00:55:53 -- common/autotest_common.sh@1205 -- # local i=0 00:21:46.210 00:55:53 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:46.210 00:55:53 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:21:46.210 00:55:53 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:46.210 00:55:53 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK9 00:21:46.210 00:55:53 -- common/autotest_common.sh@1217 -- # return 0 00:21:46.210 00:55:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:21:46.210 00:55:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:46.210 00:55:53 -- common/autotest_common.sh@10 -- # set +x 00:21:46.210 00:55:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:46.210 00:55:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.210 00:55:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:21:47.145 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:21:47.145 00:55:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:21:47.145 00:55:54 -- common/autotest_common.sh@1205 -- # local i=0 00:21:47.145 00:55:54 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:47.145 00:55:54 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:21:47.145 00:55:54 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:47.145 00:55:54 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK10 00:21:47.145 00:55:54 -- common/autotest_common.sh@1217 -- # return 0 00:21:47.145 00:55:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:21:47.145 00:55:54 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:47.145 00:55:54 -- common/autotest_common.sh@10 -- # set +x 00:21:47.145 00:55:54 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:47.145 00:55:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:47.145 00:55:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:21:48.081 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:21:48.081 00:55:55 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:21:48.081 00:55:55 -- common/autotest_common.sh@1205 -- # local i=0 00:21:48.081 00:55:55 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:21:48.081 00:55:55 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:21:48.081 00:55:55 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:21:48.081 00:55:55 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK11 00:21:48.081 00:55:55 -- common/autotest_common.sh@1217 -- # return 0 00:21:48.081 00:55:55 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:21:48.081 00:55:55 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:48.081 00:55:55 -- common/autotest_common.sh@10 -- # set +x 00:21:48.081 00:55:55 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:48.081 00:55:55 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:21:48.081 00:55:55 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:21:48.081 00:55:55 -- target/multiconnection.sh@47 -- # nvmftestfini 00:21:48.081 00:55:55 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:48.081 00:55:55 -- nvmf/common.sh@117 -- # sync 00:21:48.081 00:55:55 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:48.081 00:55:55 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:48.081 00:55:55 -- nvmf/common.sh@120 -- # set +e 00:21:48.081 00:55:55 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:48.081 00:55:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:48.081 rmmod nvme_rdma 00:21:48.081 rmmod nvme_fabrics 00:21:48.081 00:55:55 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:48.081 00:55:55 -- nvmf/common.sh@124 -- # set -e 00:21:48.081 00:55:55 -- nvmf/common.sh@125 -- # return 0 00:21:48.081 00:55:55 -- nvmf/common.sh@478 -- # '[' -n 359928 ']' 00:21:48.081 00:55:55 -- nvmf/common.sh@479 -- # killprocess 359928 00:21:48.081 00:55:55 -- common/autotest_common.sh@936 -- # '[' -z 359928 ']' 00:21:48.081 00:55:55 -- common/autotest_common.sh@940 -- # kill -0 359928 00:21:48.081 00:55:55 -- common/autotest_common.sh@941 -- # uname 00:21:48.081 00:55:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:48.081 00:55:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 359928 00:21:48.081 00:55:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:48.081 00:55:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:48.081 00:55:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 359928' 00:21:48.081 killing process with pid 359928 00:21:48.081 00:55:55 -- common/autotest_common.sh@955 -- # kill 359928 00:21:48.081 00:55:55 -- common/autotest_common.sh@960 -- # wait 359928 00:21:48.081 [2024-04-26 00:55:55.258019] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:48.651 00:55:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:48.651 00:55:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:48.651 00:21:48.651 real 1m13.088s 00:21:48.651 user 4m47.277s 00:21:48.651 sys 0m14.938s 00:21:48.651 00:55:55 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:21:48.651 00:55:55 -- common/autotest_common.sh@10 -- # set +x 00:21:48.651 ************************************ 00:21:48.651 END TEST nvmf_multiconnection 00:21:48.651 ************************************ 00:21:48.651 00:55:55 -- nvmf/nvmf.sh@67 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:48.651 00:55:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:48.651 00:55:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:48.651 00:55:55 -- common/autotest_common.sh@10 -- # set +x 00:21:48.912 ************************************ 00:21:48.912 START TEST nvmf_initiator_timeout 00:21:48.912 ************************************ 00:21:48.912 00:55:55 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=rdma 00:21:48.912 * Looking for test storage... 00:21:48.912 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:21:48.912 00:55:55 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:48.912 00:55:55 -- nvmf/common.sh@7 -- # uname -s 00:21:48.912 00:55:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:48.912 00:55:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:48.912 00:55:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:48.912 00:55:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:48.912 00:55:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:48.912 00:55:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:48.912 00:55:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:48.912 00:55:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:48.912 00:55:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:48.912 00:55:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:48.912 00:55:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:21:48.912 00:55:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:21:48.912 00:55:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:48.912 00:55:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:48.912 00:55:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:48.912 00:55:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:48.912 00:55:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:48.912 00:55:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:48.912 00:55:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:48.912 00:55:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:48.912 00:55:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.912 00:55:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.912 00:55:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.912 00:55:55 -- paths/export.sh@5 -- # export PATH 00:21:48.912 00:55:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.912 00:55:55 -- nvmf/common.sh@47 -- # : 0 00:21:48.912 00:55:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:48.912 00:55:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:48.912 00:55:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:48.912 00:55:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:48.912 00:55:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:48.912 00:55:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:48.912 00:55:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:48.912 00:55:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:48.912 00:55:55 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:48.912 00:55:55 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:48.912 00:55:55 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:21:48.912 00:55:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:48.912 00:55:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.912 00:55:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:48.912 00:55:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:48.912 00:55:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:48.912 00:55:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.912 00:55:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:48.912 00:55:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.912 00:55:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:48.912 00:55:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:48.912 00:55:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:48.912 00:55:55 -- common/autotest_common.sh@10 -- # set +x 00:21:54.188 00:56:01 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:54.188 00:56:01 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:54.188 00:56:01 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:54.188 00:56:01 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:54.188 00:56:01 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:54.188 00:56:01 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:54.188 00:56:01 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:54.188 00:56:01 -- nvmf/common.sh@295 -- # net_devs=() 00:21:54.188 00:56:01 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:54.188 00:56:01 -- nvmf/common.sh@296 -- # e810=() 00:21:54.188 00:56:01 -- nvmf/common.sh@296 -- # local -ga e810 00:21:54.188 00:56:01 -- nvmf/common.sh@297 -- # x722=() 00:21:54.188 00:56:01 -- nvmf/common.sh@297 -- # local -ga x722 00:21:54.188 00:56:01 -- nvmf/common.sh@298 -- # mlx=() 00:21:54.188 00:56:01 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:54.188 00:56:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:54.188 00:56:01 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:54.189 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:54.189 00:56:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:54.189 00:56:01 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:54.189 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:54.189 00:56:01 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:54.189 00:56:01 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.189 00:56:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.189 00:56:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:54.189 Found net devices under 0000:18:00.0: mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:54.189 00:56:01 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:54.189 00:56:01 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:54.189 Found net devices under 0000:18:00.1: mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:54.189 00:56:01 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:54.189 00:56:01 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:54.189 00:56:01 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:54.189 00:56:01 -- nvmf/common.sh@58 -- # uname 00:21:54.189 00:56:01 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:54.189 00:56:01 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:54.189 00:56:01 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:54.189 00:56:01 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:54.189 00:56:01 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:54.189 00:56:01 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:54.189 00:56:01 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:54.189 00:56:01 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:54.189 00:56:01 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:54.189 00:56:01 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:54.189 00:56:01 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:54.189 00:56:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:54.189 00:56:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:54.189 00:56:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:54.189 00:56:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:54.189 00:56:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@105 -- # continue 2 00:21:54.189 00:56:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@105 -- # continue 2 00:21:54.189 00:56:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:54.189 00:56:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:54.189 00:56:01 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:54.189 00:56:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:54.189 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:54.189 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:21:54.189 altname enp24s0f0np0 00:21:54.189 altname ens785f0np0 00:21:54.189 inet 192.168.100.8/24 scope global mlx_0_0 00:21:54.189 valid_lft forever preferred_lft forever 00:21:54.189 00:56:01 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:54.189 00:56:01 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:54.189 00:56:01 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:54.189 00:56:01 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:54.189 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:54.189 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:21:54.189 altname enp24s0f1np1 00:21:54.189 altname ens785f1np1 00:21:54.189 inet 192.168.100.9/24 scope global mlx_0_1 00:21:54.189 valid_lft forever preferred_lft forever 00:21:54.189 00:56:01 -- nvmf/common.sh@411 -- # return 0 00:21:54.189 00:56:01 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:54.189 00:56:01 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:54.189 00:56:01 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:54.189 00:56:01 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:54.189 00:56:01 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:54.189 00:56:01 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:54.189 00:56:01 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:54.189 00:56:01 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:54.189 00:56:01 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:54.189 00:56:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@105 -- # continue 2 00:21:54.189 00:56:01 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:54.189 00:56:01 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:54.189 00:56:01 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@105 -- # continue 2 00:21:54.189 00:56:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:54.189 00:56:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:54.189 00:56:01 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:54.189 00:56:01 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:54.189 00:56:01 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:54.189 00:56:01 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:54.189 192.168.100.9' 00:21:54.189 00:56:01 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:54.189 192.168.100.9' 00:21:54.189 00:56:01 -- nvmf/common.sh@446 -- # head -n 1 00:21:54.189 00:56:01 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:54.189 00:56:01 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:54.189 192.168.100.9' 00:21:54.189 00:56:01 -- nvmf/common.sh@447 -- # tail -n +2 00:21:54.189 00:56:01 -- nvmf/common.sh@447 -- # head -n 1 00:21:54.189 00:56:01 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:54.189 00:56:01 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:54.189 00:56:01 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:54.189 00:56:01 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:54.189 00:56:01 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:54.189 00:56:01 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:54.189 00:56:01 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:21:54.189 00:56:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:54.190 00:56:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:21:54.190 00:56:01 -- common/autotest_common.sh@10 -- # set +x 00:21:54.190 00:56:01 -- nvmf/common.sh@470 -- # nvmfpid=375442 00:21:54.190 00:56:01 -- nvmf/common.sh@471 -- # waitforlisten 375442 00:21:54.190 00:56:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:54.190 00:56:01 -- common/autotest_common.sh@817 -- # '[' -z 375442 ']' 00:21:54.190 00:56:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:54.190 00:56:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:21:54.190 00:56:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:54.190 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:54.190 00:56:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:21:54.190 00:56:01 -- common/autotest_common.sh@10 -- # set +x 00:21:54.190 [2024-04-26 00:56:01.360572] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:21:54.190 [2024-04-26 00:56:01.360622] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:54.448 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.448 [2024-04-26 00:56:01.411150] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:54.448 [2024-04-26 00:56:01.480796] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:54.448 [2024-04-26 00:56:01.480834] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:54.448 [2024-04-26 00:56:01.480840] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:21:54.448 [2024-04-26 00:56:01.480845] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:21:54.448 [2024-04-26 00:56:01.480849] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:54.448 [2024-04-26 00:56:01.480911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:54.448 [2024-04-26 00:56:01.481003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:54.448 [2024-04-26 00:56:01.481066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:54.448 [2024-04-26 00:56:01.481067] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:55.016 00:56:02 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:21:55.016 00:56:02 -- common/autotest_common.sh@850 -- # return 0 00:21:55.016 00:56:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:55.016 00:56:02 -- common/autotest_common.sh@716 -- # xtrace_disable 00:21:55.016 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.016 00:56:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:55.016 00:56:02 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:55.016 00:56:02 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:55.016 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.016 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.016 Malloc0 00:21:55.016 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.016 00:56:02 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:21:55.016 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.016 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.274 Delay0 00:21:55.274 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.274 00:56:02 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:21:55.274 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.274 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.274 [2024-04-26 00:56:02.238344] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x165a250/0x1702b40) succeed. 00:21:55.274 [2024-04-26 00:56:02.247842] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x165b5c0/0x15c2940) succeed. 00:21:55.274 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.274 00:56:02 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:21:55.274 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.274 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.275 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.275 00:56:02 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:21:55.275 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.275 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.275 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.275 00:56:02 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:21:55.275 00:56:02 -- common/autotest_common.sh@549 -- # xtrace_disable 00:21:55.275 00:56:02 -- common/autotest_common.sh@10 -- # set +x 00:21:55.275 [2024-04-26 00:56:02.384175] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:21:55.275 00:56:02 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:21:55.275 00:56:02 -- target/initiator_timeout.sh@29 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:21:56.210 00:56:03 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:21:56.210 00:56:03 -- common/autotest_common.sh@1184 -- # local i=0 00:21:56.210 00:56:03 -- common/autotest_common.sh@1185 -- # local nvme_device_counter=1 nvme_devices=0 00:21:56.210 00:56:03 -- common/autotest_common.sh@1186 -- # [[ -n '' ]] 00:21:56.210 00:56:03 -- common/autotest_common.sh@1191 -- # sleep 2 00:21:58.745 00:56:05 -- common/autotest_common.sh@1192 -- # (( i++ <= 15 )) 00:21:58.745 00:56:05 -- common/autotest_common.sh@1193 -- # lsblk -l -o NAME,SERIAL 00:21:58.745 00:56:05 -- common/autotest_common.sh@1193 -- # grep -c SPDKISFASTANDAWESOME 00:21:58.745 00:56:05 -- common/autotest_common.sh@1193 -- # nvme_devices=1 00:21:58.745 00:56:05 -- common/autotest_common.sh@1194 -- # (( nvme_devices == nvme_device_counter )) 00:21:58.745 00:56:05 -- common/autotest_common.sh@1194 -- # return 0 00:21:58.745 00:56:05 -- target/initiator_timeout.sh@35 -- # fio_pid=376213 00:21:58.745 00:56:05 -- target/initiator_timeout.sh@37 -- # sleep 3 00:21:58.745 00:56:05 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:21:58.745 [global] 00:21:58.745 thread=1 00:21:58.745 invalidate=1 00:21:58.745 rw=write 00:21:58.745 time_based=1 00:21:58.745 runtime=60 00:21:58.745 ioengine=libaio 00:21:58.745 direct=1 00:21:58.745 bs=4096 00:21:58.745 iodepth=1 00:21:58.745 norandommap=0 00:21:58.745 numjobs=1 00:21:58.745 00:21:58.745 verify_dump=1 00:21:58.745 verify_backlog=512 00:21:58.745 verify_state_save=0 00:21:58.745 do_verify=1 00:21:58.745 verify=crc32c-intel 00:21:58.745 [job0] 00:21:58.745 filename=/dev/nvme0n1 00:21:58.745 Could not set queue depth (nvme0n1) 00:21:58.745 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:21:58.745 fio-3.35 00:21:58.745 Starting 1 thread 00:22:01.279 00:56:08 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:01.279 00:56:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.279 00:56:08 -- common/autotest_common.sh@10 -- # set +x 00:22:01.279 true 00:22:01.279 00:56:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.279 00:56:08 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:01.279 00:56:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.279 00:56:08 -- common/autotest_common.sh@10 -- # set +x 00:22:01.279 true 00:22:01.279 00:56:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.279 00:56:08 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:01.279 00:56:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.279 00:56:08 -- common/autotest_common.sh@10 -- # set +x 00:22:01.279 true 00:22:01.279 00:56:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.279 00:56:08 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:01.279 00:56:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:01.279 00:56:08 -- common/autotest_common.sh@10 -- # set +x 00:22:01.279 true 00:22:01.279 00:56:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:01.279 00:56:08 -- target/initiator_timeout.sh@45 -- # sleep 3 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:22:04.567 00:56:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.567 00:56:11 -- common/autotest_common.sh@10 -- # set +x 00:22:04.567 true 00:22:04.567 00:56:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:22:04.567 00:56:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.567 00:56:11 -- common/autotest_common.sh@10 -- # set +x 00:22:04.567 true 00:22:04.567 00:56:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:22:04.567 00:56:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.567 00:56:11 -- common/autotest_common.sh@10 -- # set +x 00:22:04.567 true 00:22:04.567 00:56:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:22:04.567 00:56:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:22:04.567 00:56:11 -- common/autotest_common.sh@10 -- # set +x 00:22:04.567 true 00:22:04.567 00:56:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:22:04.567 00:56:11 -- target/initiator_timeout.sh@54 -- # wait 376213 00:23:00.799 00:23:00.799 job0: (groupid=0, jobs=1): err= 0: pid=376392: Fri Apr 26 00:57:05 2024 00:23:00.799 read: IOPS=1348, BW=5393KiB/s (5523kB/s)(316MiB/60000msec) 00:23:00.799 slat (usec): min=3, max=11972, avg= 7.41, stdev=59.20 00:23:00.799 clat (usec): min=70, max=42610k, avg=624.60, stdev=149811.22 00:23:00.799 lat (usec): min=89, max=42610k, avg=632.01, stdev=149811.23 00:23:00.799 clat percentiles (usec): 00:23:00.799 | 1.00th=[ 87], 5.00th=[ 89], 10.00th=[ 91], 20.00th=[ 93], 00:23:00.799 | 30.00th=[ 94], 40.00th=[ 96], 50.00th=[ 97], 60.00th=[ 99], 00:23:00.799 | 70.00th=[ 100], 80.00th=[ 102], 90.00th=[ 105], 95.00th=[ 109], 00:23:00.799 | 99.00th=[ 116], 99.50th=[ 122], 99.90th=[ 217], 99.95th=[ 245], 00:23:00.799 | 99.99th=[ 347] 00:23:00.799 write: IOPS=1356, BW=5425KiB/s (5556kB/s)(318MiB/60000msec); 0 zone resets 00:23:00.799 slat (usec): min=6, max=278, avg= 9.36, stdev= 1.88 00:23:00.799 clat (usec): min=67, max=576, avg=95.53, stdev=10.39 00:23:00.799 lat (usec): min=89, max=585, avg=104.89, stdev=10.61 00:23:00.799 clat percentiles (usec): 00:23:00.799 | 1.00th=[ 85], 5.00th=[ 87], 10.00th=[ 88], 20.00th=[ 90], 00:23:00.799 | 30.00th=[ 92], 40.00th=[ 93], 50.00th=[ 95], 60.00th=[ 96], 00:23:00.799 | 70.00th=[ 98], 80.00th=[ 100], 90.00th=[ 103], 95.00th=[ 106], 00:23:00.799 | 99.00th=[ 114], 99.50th=[ 123], 99.90th=[ 233], 99.95th=[ 293], 00:23:00.799 | 99.99th=[ 408] 00:23:00.799 bw ( KiB/s): min= 4096, max=20480, per=100.00%, avg=18099.43, stdev=2899.05, samples=35 00:23:00.799 iops : min= 1024, max= 5120, avg=4524.86, stdev=724.76, samples=35 00:23:00.799 lat (usec) : 100=74.66%, 250=25.29%, 500=0.05%, 750=0.01%, 1000=0.01% 00:23:00.799 lat (msec) : >=2000=0.01% 00:23:00.799 cpu : usr=1.33%, sys=2.22%, ctx=162284, majf=0, minf=107 00:23:00.799 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:00.799 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:00.799 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:00.799 issued rwts: total=80896,81380,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:00.799 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:00.799 00:23:00.799 Run status group 0 (all jobs): 00:23:00.799 READ: bw=5393KiB/s (5523kB/s), 5393KiB/s-5393KiB/s (5523kB/s-5523kB/s), io=316MiB (331MB), run=60000-60000msec 00:23:00.799 WRITE: bw=5425KiB/s (5556kB/s), 5425KiB/s-5425KiB/s (5556kB/s-5556kB/s), io=318MiB (333MB), run=60000-60000msec 00:23:00.799 00:23:00.799 Disk stats (read/write): 00:23:00.799 nvme0n1: ios=80781/80896, merge=0/0, ticks=7553/7385, in_queue=14938, util=99.81% 00:23:00.799 00:57:05 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:00.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:00.799 00:57:06 -- common/autotest_common.sh@1205 -- # local i=0 00:23:00.799 00:57:06 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:23:00.799 00:57:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:00.799 00:57:06 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:23:00.799 00:57:06 -- common/autotest_common.sh@1213 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:00.799 00:57:06 -- common/autotest_common.sh@1217 -- # return 0 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:00.799 nvmf hotplug test: fio successful as expected 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:00.799 00:57:06 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:00.799 00:57:06 -- common/autotest_common.sh@10 -- # set +x 00:23:00.799 00:57:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:00.799 00:57:06 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:00.799 00:57:06 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:00.799 00:57:06 -- nvmf/common.sh@117 -- # sync 00:23:00.799 00:57:06 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:00.799 00:57:06 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:00.799 00:57:06 -- nvmf/common.sh@120 -- # set +e 00:23:00.799 00:57:06 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:00.799 00:57:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:00.799 rmmod nvme_rdma 00:23:00.799 rmmod nvme_fabrics 00:23:00.799 00:57:06 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:00.799 00:57:06 -- nvmf/common.sh@124 -- # set -e 00:23:00.799 00:57:06 -- nvmf/common.sh@125 -- # return 0 00:23:00.799 00:57:06 -- nvmf/common.sh@478 -- # '[' -n 375442 ']' 00:23:00.799 00:57:06 -- nvmf/common.sh@479 -- # killprocess 375442 00:23:00.799 00:57:06 -- common/autotest_common.sh@936 -- # '[' -z 375442 ']' 00:23:00.799 00:57:06 -- common/autotest_common.sh@940 -- # kill -0 375442 00:23:00.799 00:57:06 -- common/autotest_common.sh@941 -- # uname 00:23:00.799 00:57:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:00.799 00:57:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 375442 00:23:00.799 00:57:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:00.799 00:57:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:00.799 00:57:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 375442' 00:23:00.799 killing process with pid 375442 00:23:00.799 00:57:06 -- common/autotest_common.sh@955 -- # kill 375442 00:23:00.799 00:57:06 -- common/autotest_common.sh@960 -- # wait 375442 00:23:00.799 [2024-04-26 00:57:06.986446] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:00.799 00:57:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:00.799 00:57:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:00.799 00:23:00.799 real 1m11.352s 00:23:00.799 user 4m31.682s 00:23:00.799 sys 0m6.651s 00:23:00.799 00:57:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:23:00.799 00:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:00.799 ************************************ 00:23:00.799 END TEST nvmf_initiator_timeout 00:23:00.799 ************************************ 00:23:00.799 00:57:07 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:23:00.799 00:57:07 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:23:00.799 00:57:07 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:23:00.799 00:57:07 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:23:00.799 00:57:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:00.799 00:57:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:00.799 00:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:00.799 ************************************ 00:23:00.799 START TEST nvmf_device_removal 00:23:00.799 ************************************ 00:23:00.799 00:57:07 -- common/autotest_common.sh@1111 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:23:00.800 * Looking for test storage... 00:23:00.800 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.800 00:57:07 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:23:00.800 00:57:07 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:23:00.800 00:57:07 -- common/autotest_common.sh@34 -- # set -e 00:23:00.800 00:57:07 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:23:00.800 00:57:07 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:23:00.800 00:57:07 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:23:00.800 00:57:07 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:23:00.800 00:57:07 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:23:00.800 00:57:07 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:23:00.800 00:57:07 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:23:00.800 00:57:07 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:23:00.800 00:57:07 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:23:00.800 00:57:07 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:23:00.800 00:57:07 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:23:00.800 00:57:07 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:23:00.800 00:57:07 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:23:00.800 00:57:07 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:23:00.800 00:57:07 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:23:00.800 00:57:07 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:23:00.800 00:57:07 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:23:00.800 00:57:07 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:23:00.800 00:57:07 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:23:00.800 00:57:07 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:23:00.800 00:57:07 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:23:00.800 00:57:07 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:23:00.800 00:57:07 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:23:00.800 00:57:07 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:23:00.800 00:57:07 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:23:00.800 00:57:07 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:23:00.800 00:57:07 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:23:00.800 00:57:07 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:23:00.800 00:57:07 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:23:00.800 00:57:07 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:23:00.800 00:57:07 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:23:00.800 00:57:07 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:23:00.800 00:57:07 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:23:00.800 00:57:07 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:23:00.800 00:57:07 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:23:00.800 00:57:07 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:23:00.800 00:57:07 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:23:00.800 00:57:07 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:23:00.800 00:57:07 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:23:00.800 00:57:07 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:23:00.800 00:57:07 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:23:00.800 00:57:07 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:23:00.800 00:57:07 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:23:00.800 00:57:07 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:23:00.800 00:57:07 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:23:00.800 00:57:07 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:23:00.800 00:57:07 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:23:00.800 00:57:07 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:23:00.800 00:57:07 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:23:00.800 00:57:07 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:23:00.800 00:57:07 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:23:00.800 00:57:07 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:23:00.800 00:57:07 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:23:00.800 00:57:07 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:23:00.800 00:57:07 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:23:00.800 00:57:07 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:23:00.800 00:57:07 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:23:00.800 00:57:07 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:23:00.800 00:57:07 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:23:00.800 00:57:07 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:23:00.800 00:57:07 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:23:00.800 00:57:07 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:23:00.800 00:57:07 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:23:00.800 00:57:07 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:23:00.800 00:57:07 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:23:00.800 00:57:07 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:23:00.800 00:57:07 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:23:00.800 00:57:07 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:23:00.800 00:57:07 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:23:00.800 00:57:07 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:23:00.800 00:57:07 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:23:00.800 00:57:07 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:23:00.800 00:57:07 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:23:00.800 00:57:07 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:23:00.800 00:57:07 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:23:00.800 00:57:07 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:23:00.800 00:57:07 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:23:00.800 00:57:07 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:23:00.800 00:57:07 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:23:00.800 00:57:07 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:23:00.800 00:57:07 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:23:00.800 00:57:07 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:23:00.800 00:57:07 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:23:00.800 00:57:07 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:23:00.800 00:57:07 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:23:00.800 00:57:07 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:23:00.800 00:57:07 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:23:00.800 00:57:07 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:23:00.800 00:57:07 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:23:00.800 00:57:07 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:23:00.800 00:57:07 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:23:00.800 00:57:07 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:23:00.800 00:57:07 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:23:00.800 00:57:07 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:23:00.800 00:57:07 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:23:00.800 00:57:07 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:23:00.800 #define SPDK_CONFIG_H 00:23:00.800 #define SPDK_CONFIG_APPS 1 00:23:00.800 #define SPDK_CONFIG_ARCH native 00:23:00.800 #undef SPDK_CONFIG_ASAN 00:23:00.800 #undef SPDK_CONFIG_AVAHI 00:23:00.800 #undef SPDK_CONFIG_CET 00:23:00.800 #define SPDK_CONFIG_COVERAGE 1 00:23:00.800 #define SPDK_CONFIG_CROSS_PREFIX 00:23:00.800 #undef SPDK_CONFIG_CRYPTO 00:23:00.800 #undef SPDK_CONFIG_CRYPTO_MLX5 00:23:00.800 #undef SPDK_CONFIG_CUSTOMOCF 00:23:00.800 #undef SPDK_CONFIG_DAOS 00:23:00.800 #define SPDK_CONFIG_DAOS_DIR 00:23:00.800 #define SPDK_CONFIG_DEBUG 1 00:23:00.800 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:23:00.800 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:23:00.800 #define SPDK_CONFIG_DPDK_INC_DIR 00:23:00.800 #define SPDK_CONFIG_DPDK_LIB_DIR 00:23:00.800 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:23:00.800 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:23:00.800 #define SPDK_CONFIG_EXAMPLES 1 00:23:00.800 #undef SPDK_CONFIG_FC 00:23:00.800 #define SPDK_CONFIG_FC_PATH 00:23:00.800 #define SPDK_CONFIG_FIO_PLUGIN 1 00:23:00.800 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:23:00.800 #undef SPDK_CONFIG_FUSE 00:23:00.800 #undef SPDK_CONFIG_FUZZER 00:23:00.800 #define SPDK_CONFIG_FUZZER_LIB 00:23:00.800 #undef SPDK_CONFIG_GOLANG 00:23:00.800 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:23:00.800 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:23:00.800 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:23:00.800 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:23:00.800 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:23:00.800 #undef SPDK_CONFIG_HAVE_LIBBSD 00:23:00.800 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:23:00.800 #define SPDK_CONFIG_IDXD 1 00:23:00.800 #undef SPDK_CONFIG_IDXD_KERNEL 00:23:00.800 #undef SPDK_CONFIG_IPSEC_MB 00:23:00.800 #define SPDK_CONFIG_IPSEC_MB_DIR 00:23:00.800 #define SPDK_CONFIG_ISAL 1 00:23:00.800 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:23:00.800 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:23:00.800 #define SPDK_CONFIG_LIBDIR 00:23:00.800 #undef SPDK_CONFIG_LTO 00:23:00.800 #define SPDK_CONFIG_MAX_LCORES 00:23:00.800 #define SPDK_CONFIG_NVME_CUSE 1 00:23:00.800 #undef SPDK_CONFIG_OCF 00:23:00.800 #define SPDK_CONFIG_OCF_PATH 00:23:00.800 #define SPDK_CONFIG_OPENSSL_PATH 00:23:00.800 #undef SPDK_CONFIG_PGO_CAPTURE 00:23:00.800 #define SPDK_CONFIG_PGO_DIR 00:23:00.800 #undef SPDK_CONFIG_PGO_USE 00:23:00.801 #define SPDK_CONFIG_PREFIX /usr/local 00:23:00.801 #undef SPDK_CONFIG_RAID5F 00:23:00.801 #undef SPDK_CONFIG_RBD 00:23:00.801 #define SPDK_CONFIG_RDMA 1 00:23:00.801 #define SPDK_CONFIG_RDMA_PROV verbs 00:23:00.801 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:23:00.801 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:23:00.801 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:23:00.801 #define SPDK_CONFIG_SHARED 1 00:23:00.801 #undef SPDK_CONFIG_SMA 00:23:00.801 #define SPDK_CONFIG_TESTS 1 00:23:00.801 #undef SPDK_CONFIG_TSAN 00:23:00.801 #define SPDK_CONFIG_UBLK 1 00:23:00.801 #define SPDK_CONFIG_UBSAN 1 00:23:00.801 #undef SPDK_CONFIG_UNIT_TESTS 00:23:00.801 #undef SPDK_CONFIG_URING 00:23:00.801 #define SPDK_CONFIG_URING_PATH 00:23:00.801 #undef SPDK_CONFIG_URING_ZNS 00:23:00.801 #undef SPDK_CONFIG_USDT 00:23:00.801 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:23:00.801 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:23:00.801 #undef SPDK_CONFIG_VFIO_USER 00:23:00.801 #define SPDK_CONFIG_VFIO_USER_DIR 00:23:00.801 #define SPDK_CONFIG_VHOST 1 00:23:00.801 #define SPDK_CONFIG_VIRTIO 1 00:23:00.801 #undef SPDK_CONFIG_VTUNE 00:23:00.801 #define SPDK_CONFIG_VTUNE_DIR 00:23:00.801 #define SPDK_CONFIG_WERROR 1 00:23:00.801 #define SPDK_CONFIG_WPDK_DIR 00:23:00.801 #undef SPDK_CONFIG_XNVME 00:23:00.801 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:23:00.801 00:57:07 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:23:00.801 00:57:07 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:00.801 00:57:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.801 00:57:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.801 00:57:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.801 00:57:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.801 00:57:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.801 00:57:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.801 00:57:07 -- paths/export.sh@5 -- # export PATH 00:23:00.801 00:57:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.801 00:57:07 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:23:00.801 00:57:07 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:23:00.801 00:57:07 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:23:00.801 00:57:07 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:23:00.801 00:57:07 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:23:00.801 00:57:07 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:23:00.801 00:57:07 -- pm/common@67 -- # TEST_TAG=N/A 00:23:00.801 00:57:07 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:23:00.801 00:57:07 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:23:00.801 00:57:07 -- pm/common@71 -- # uname -s 00:23:00.801 00:57:07 -- pm/common@71 -- # PM_OS=Linux 00:23:00.801 00:57:07 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:23:00.801 00:57:07 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:23:00.801 00:57:07 -- pm/common@76 -- # [[ Linux == Linux ]] 00:23:00.801 00:57:07 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:23:00.801 00:57:07 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:23:00.801 00:57:07 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:23:00.801 00:57:07 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:23:00.801 00:57:07 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:23:00.801 00:57:07 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:23:00.801 00:57:07 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:23:00.801 00:57:07 -- common/autotest_common.sh@57 -- # : 1 00:23:00.801 00:57:07 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:23:00.801 00:57:07 -- common/autotest_common.sh@61 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:23:00.801 00:57:07 -- common/autotest_common.sh@63 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:23:00.801 00:57:07 -- common/autotest_common.sh@65 -- # : 1 00:23:00.801 00:57:07 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:23:00.801 00:57:07 -- common/autotest_common.sh@67 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:23:00.801 00:57:07 -- common/autotest_common.sh@69 -- # : 00:23:00.801 00:57:07 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:23:00.801 00:57:07 -- common/autotest_common.sh@71 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:23:00.801 00:57:07 -- common/autotest_common.sh@73 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:23:00.801 00:57:07 -- common/autotest_common.sh@75 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:23:00.801 00:57:07 -- common/autotest_common.sh@77 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:23:00.801 00:57:07 -- common/autotest_common.sh@79 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:23:00.801 00:57:07 -- common/autotest_common.sh@81 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:23:00.801 00:57:07 -- common/autotest_common.sh@83 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:23:00.801 00:57:07 -- common/autotest_common.sh@85 -- # : 1 00:23:00.801 00:57:07 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:23:00.801 00:57:07 -- common/autotest_common.sh@87 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:23:00.801 00:57:07 -- common/autotest_common.sh@89 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:23:00.801 00:57:07 -- common/autotest_common.sh@91 -- # : 1 00:23:00.801 00:57:07 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:23:00.801 00:57:07 -- common/autotest_common.sh@93 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:23:00.801 00:57:07 -- common/autotest_common.sh@95 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:23:00.801 00:57:07 -- common/autotest_common.sh@97 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:23:00.801 00:57:07 -- common/autotest_common.sh@99 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:23:00.801 00:57:07 -- common/autotest_common.sh@101 -- # : rdma 00:23:00.801 00:57:07 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:23:00.801 00:57:07 -- common/autotest_common.sh@103 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:23:00.801 00:57:07 -- common/autotest_common.sh@105 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:23:00.801 00:57:07 -- common/autotest_common.sh@107 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:23:00.801 00:57:07 -- common/autotest_common.sh@109 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:23:00.801 00:57:07 -- common/autotest_common.sh@111 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:23:00.801 00:57:07 -- common/autotest_common.sh@113 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:23:00.801 00:57:07 -- common/autotest_common.sh@115 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:23:00.801 00:57:07 -- common/autotest_common.sh@117 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:23:00.801 00:57:07 -- common/autotest_common.sh@119 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:23:00.801 00:57:07 -- common/autotest_common.sh@121 -- # : 1 00:23:00.801 00:57:07 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:23:00.801 00:57:07 -- common/autotest_common.sh@123 -- # : 00:23:00.801 00:57:07 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:23:00.801 00:57:07 -- common/autotest_common.sh@125 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:23:00.801 00:57:07 -- common/autotest_common.sh@127 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:23:00.801 00:57:07 -- common/autotest_common.sh@129 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:23:00.801 00:57:07 -- common/autotest_common.sh@131 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:23:00.801 00:57:07 -- common/autotest_common.sh@133 -- # : 0 00:23:00.801 00:57:07 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:23:00.801 00:57:07 -- common/autotest_common.sh@135 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:23:00.802 00:57:07 -- common/autotest_common.sh@137 -- # : 00:23:00.802 00:57:07 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:23:00.802 00:57:07 -- common/autotest_common.sh@139 -- # : true 00:23:00.802 00:57:07 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:23:00.802 00:57:07 -- common/autotest_common.sh@141 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:23:00.802 00:57:07 -- common/autotest_common.sh@143 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:23:00.802 00:57:07 -- common/autotest_common.sh@145 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:23:00.802 00:57:07 -- common/autotest_common.sh@147 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:23:00.802 00:57:07 -- common/autotest_common.sh@149 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:23:00.802 00:57:07 -- common/autotest_common.sh@151 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:23:00.802 00:57:07 -- common/autotest_common.sh@153 -- # : mlx5 00:23:00.802 00:57:07 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:23:00.802 00:57:07 -- common/autotest_common.sh@155 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:23:00.802 00:57:07 -- common/autotest_common.sh@157 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:23:00.802 00:57:07 -- common/autotest_common.sh@159 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:23:00.802 00:57:07 -- common/autotest_common.sh@161 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:23:00.802 00:57:07 -- common/autotest_common.sh@163 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:23:00.802 00:57:07 -- common/autotest_common.sh@166 -- # : 00:23:00.802 00:57:07 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:23:00.802 00:57:07 -- common/autotest_common.sh@168 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:23:00.802 00:57:07 -- common/autotest_common.sh@170 -- # : 0 00:23:00.802 00:57:07 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:23:00.802 00:57:07 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:23:00.802 00:57:07 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:23:00.802 00:57:07 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:23:00.802 00:57:07 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:23:00.802 00:57:07 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:23:00.802 00:57:07 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:23:00.802 00:57:07 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:23:00.802 00:57:07 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:23:00.802 00:57:07 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:23:00.802 00:57:07 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:23:00.802 00:57:07 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:23:00.802 00:57:07 -- common/autotest_common.sh@199 -- # cat 00:23:00.802 00:57:07 -- common/autotest_common.sh@225 -- # echo leak:libfuse3.so 00:23:00.802 00:57:07 -- common/autotest_common.sh@227 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:23:00.802 00:57:07 -- common/autotest_common.sh@227 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:23:00.802 00:57:07 -- common/autotest_common.sh@229 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:23:00.802 00:57:07 -- common/autotest_common.sh@229 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:23:00.802 00:57:07 -- common/autotest_common.sh@231 -- # '[' -z /var/spdk/dependencies ']' 00:23:00.802 00:57:07 -- common/autotest_common.sh@234 -- # export DEPENDENCY_DIR 00:23:00.802 00:57:07 -- common/autotest_common.sh@238 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:23:00.802 00:57:07 -- common/autotest_common.sh@238 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:23:00.802 00:57:07 -- common/autotest_common.sh@239 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:23:00.802 00:57:07 -- common/autotest_common.sh@239 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:23:00.802 00:57:07 -- common/autotest_common.sh@242 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:23:00.802 00:57:07 -- common/autotest_common.sh@242 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:23:00.802 00:57:07 -- common/autotest_common.sh@243 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:23:00.802 00:57:07 -- common/autotest_common.sh@243 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:23:00.802 00:57:07 -- common/autotest_common.sh@245 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:23:00.802 00:57:07 -- common/autotest_common.sh@245 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:23:00.802 00:57:07 -- common/autotest_common.sh@248 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@248 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@251 -- # '[' 0 -eq 0 ']' 00:23:00.802 00:57:07 -- common/autotest_common.sh@252 -- # export valgrind= 00:23:00.802 00:57:07 -- common/autotest_common.sh@252 -- # valgrind= 00:23:00.802 00:57:07 -- common/autotest_common.sh@258 -- # uname -s 00:23:00.802 00:57:07 -- common/autotest_common.sh@258 -- # '[' Linux = Linux ']' 00:23:00.802 00:57:07 -- common/autotest_common.sh@259 -- # HUGEMEM=4096 00:23:00.802 00:57:07 -- common/autotest_common.sh@260 -- # export CLEAR_HUGE=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@260 -- # CLEAR_HUGE=yes 00:23:00.802 00:57:07 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@261 -- # [[ 0 -eq 1 ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@268 -- # MAKE=make 00:23:00.802 00:57:07 -- common/autotest_common.sh@269 -- # MAKEFLAGS=-j112 00:23:00.802 00:57:07 -- common/autotest_common.sh@285 -- # export HUGEMEM=4096 00:23:00.802 00:57:07 -- common/autotest_common.sh@285 -- # HUGEMEM=4096 00:23:00.802 00:57:07 -- common/autotest_common.sh@287 -- # NO_HUGE=() 00:23:00.802 00:57:07 -- common/autotest_common.sh@288 -- # TEST_MODE= 00:23:00.802 00:57:07 -- common/autotest_common.sh@289 -- # for i in "$@" 00:23:00.802 00:57:07 -- common/autotest_common.sh@290 -- # case "$i" in 00:23:00.802 00:57:07 -- common/autotest_common.sh@295 -- # TEST_TRANSPORT=rdma 00:23:00.802 00:57:07 -- common/autotest_common.sh@307 -- # [[ -z 387926 ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@307 -- # kill -0 387926 00:23:00.802 00:57:07 -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:23:00.802 00:57:07 -- common/autotest_common.sh@317 -- # [[ -v testdir ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@319 -- # local requested_size=2147483648 00:23:00.802 00:57:07 -- common/autotest_common.sh@320 -- # local mount target_dir 00:23:00.802 00:57:07 -- common/autotest_common.sh@322 -- # local -A mounts fss sizes avails uses 00:23:00.802 00:57:07 -- common/autotest_common.sh@323 -- # local source fs size avail mount use 00:23:00.802 00:57:07 -- common/autotest_common.sh@325 -- # local storage_fallback storage_candidates 00:23:00.802 00:57:07 -- common/autotest_common.sh@327 -- # mktemp -udt spdk.XXXXXX 00:23:00.802 00:57:07 -- common/autotest_common.sh@327 -- # storage_fallback=/tmp/spdk.2OaRvv 00:23:00.802 00:57:07 -- common/autotest_common.sh@332 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:23:00.802 00:57:07 -- common/autotest_common.sh@334 -- # [[ -n '' ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@339 -- # [[ -n '' ]] 00:23:00.802 00:57:07 -- common/autotest_common.sh@344 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.2OaRvv/tests/target /tmp/spdk.2OaRvv 00:23:00.802 00:57:07 -- common/autotest_common.sh@347 -- # requested_size=2214592512 00:23:00.802 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@316 -- # df -T 00:23:00.803 00:57:07 -- common/autotest_common.sh@316 -- # grep -v Filesystem 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_devtmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=devtmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=67108864 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=67108864 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=0 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=/dev/pmem0 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=ext2 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=958902272 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=5284429824 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=4325527552 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=spdk_root 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=overlay 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=90119192576 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=95554736128 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=5435543552 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=47770361856 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777366016 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=7004160 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=19087872000 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=19110948864 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=23076864 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=47777062912 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=47777370112 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=307200 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # mounts["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@350 -- # fss["$mount"]=tmpfs 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # avails["$mount"]=9555468288 00:23:00.803 00:57:07 -- common/autotest_common.sh@351 -- # sizes["$mount"]=9555472384 00:23:00.803 00:57:07 -- common/autotest_common.sh@352 -- # uses["$mount"]=4096 00:23:00.803 00:57:07 -- common/autotest_common.sh@349 -- # read -r source fs size use avail _ mount 00:23:00.803 00:57:07 -- common/autotest_common.sh@355 -- # printf '* Looking for test storage...\n' 00:23:00.803 * Looking for test storage... 00:23:00.803 00:57:07 -- common/autotest_common.sh@357 -- # local target_space new_size 00:23:00.803 00:57:07 -- common/autotest_common.sh@358 -- # for target_dir in "${storage_candidates[@]}" 00:23:00.803 00:57:07 -- common/autotest_common.sh@361 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.803 00:57:07 -- common/autotest_common.sh@361 -- # awk '$1 !~ /Filesystem/{print $6}' 00:23:00.803 00:57:07 -- common/autotest_common.sh@361 -- # mount=/ 00:23:00.803 00:57:07 -- common/autotest_common.sh@363 -- # target_space=90119192576 00:23:00.803 00:57:07 -- common/autotest_common.sh@364 -- # (( target_space == 0 || target_space < requested_size )) 00:23:00.803 00:57:07 -- common/autotest_common.sh@367 -- # (( target_space >= requested_size )) 00:23:00.803 00:57:07 -- common/autotest_common.sh@369 -- # [[ overlay == tmpfs ]] 00:23:00.803 00:57:07 -- common/autotest_common.sh@369 -- # [[ overlay == ramfs ]] 00:23:00.803 00:57:07 -- common/autotest_common.sh@369 -- # [[ / == / ]] 00:23:00.803 00:57:07 -- common/autotest_common.sh@370 -- # new_size=7650136064 00:23:00.803 00:57:07 -- common/autotest_common.sh@371 -- # (( new_size * 100 / sizes[/] > 95 )) 00:23:00.803 00:57:07 -- common/autotest_common.sh@376 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.803 00:57:07 -- common/autotest_common.sh@376 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.803 00:57:07 -- common/autotest_common.sh@377 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.803 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:00.803 00:57:07 -- common/autotest_common.sh@378 -- # return 0 00:23:00.803 00:57:07 -- common/autotest_common.sh@1668 -- # set -o errtrace 00:23:00.803 00:57:07 -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:23:00.803 00:57:07 -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:23:00.803 00:57:07 -- common/autotest_common.sh@1672 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:23:00.803 00:57:07 -- common/autotest_common.sh@1673 -- # true 00:23:00.803 00:57:07 -- common/autotest_common.sh@1675 -- # xtrace_fd 00:23:00.803 00:57:07 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:23:00.803 00:57:07 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:23:00.803 00:57:07 -- common/autotest_common.sh@27 -- # exec 00:23:00.803 00:57:07 -- common/autotest_common.sh@29 -- # exec 00:23:00.803 00:57:07 -- common/autotest_common.sh@31 -- # xtrace_restore 00:23:00.803 00:57:07 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:23:00.803 00:57:07 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:23:00.803 00:57:07 -- common/autotest_common.sh@18 -- # set -x 00:23:00.803 00:57:07 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:00.803 00:57:07 -- nvmf/common.sh@7 -- # uname -s 00:23:00.803 00:57:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:00.803 00:57:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:00.803 00:57:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:00.803 00:57:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:00.803 00:57:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:00.803 00:57:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:00.803 00:57:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:00.803 00:57:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:00.803 00:57:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:00.803 00:57:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:00.803 00:57:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:23:00.803 00:57:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:23:00.803 00:57:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:00.803 00:57:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:00.803 00:57:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:00.803 00:57:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:00.803 00:57:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:00.803 00:57:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:00.803 00:57:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:00.803 00:57:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:00.803 00:57:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.803 00:57:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.803 00:57:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.803 00:57:07 -- paths/export.sh@5 -- # export PATH 00:23:00.803 00:57:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:00.803 00:57:07 -- nvmf/common.sh@47 -- # : 0 00:23:00.803 00:57:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:00.803 00:57:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:00.803 00:57:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:00.803 00:57:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:00.803 00:57:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:00.803 00:57:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:00.803 00:57:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:00.803 00:57:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:00.803 00:57:07 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:23:00.804 00:57:07 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:23:00.804 00:57:07 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:00.804 00:57:07 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:23:00.804 00:57:07 -- target/device_removal.sh@18 -- # nvmftestinit 00:23:00.804 00:57:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:00.804 00:57:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:00.804 00:57:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:00.804 00:57:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:00.804 00:57:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:00.804 00:57:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.804 00:57:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.804 00:57:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:00.804 00:57:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:00.804 00:57:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:00.804 00:57:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:00.804 00:57:07 -- common/autotest_common.sh@10 -- # set +x 00:23:06.072 00:57:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:06.072 00:57:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:06.072 00:57:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:06.072 00:57:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:06.072 00:57:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:06.072 00:57:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:06.072 00:57:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:06.072 00:57:12 -- nvmf/common.sh@295 -- # net_devs=() 00:23:06.072 00:57:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:06.072 00:57:12 -- nvmf/common.sh@296 -- # e810=() 00:23:06.072 00:57:12 -- nvmf/common.sh@296 -- # local -ga e810 00:23:06.072 00:57:12 -- nvmf/common.sh@297 -- # x722=() 00:23:06.072 00:57:12 -- nvmf/common.sh@297 -- # local -ga x722 00:23:06.072 00:57:12 -- nvmf/common.sh@298 -- # mlx=() 00:23:06.072 00:57:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:06.072 00:57:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:06.072 00:57:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:06.072 00:57:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:06.072 00:57:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:06.072 00:57:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:06.072 00:57:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:06.072 00:57:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:06.072 00:57:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:23:06.072 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:23:06.072 00:57:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:06.072 00:57:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:06.072 00:57:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:23:06.072 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:23:06.072 00:57:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:06.072 00:57:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:06.072 00:57:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:06.072 00:57:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:06.072 00:57:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:06.072 00:57:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:06.072 00:57:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:06.072 00:57:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:23:06.072 Found net devices under 0000:18:00.0: mlx_0_0 00:23:06.072 00:57:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:06.072 00:57:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:06.073 00:57:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:06.073 00:57:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:06.073 00:57:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:23:06.073 Found net devices under 0000:18:00.1: mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:06.073 00:57:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:06.073 00:57:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:06.073 00:57:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:06.073 00:57:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:06.073 00:57:12 -- nvmf/common.sh@58 -- # uname 00:23:06.073 00:57:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:06.073 00:57:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:06.073 00:57:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:06.073 00:57:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:06.073 00:57:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:06.073 00:57:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:06.073 00:57:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:06.073 00:57:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:06.073 00:57:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:06.073 00:57:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:06.073 00:57:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:06.073 00:57:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:06.073 00:57:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:06.073 00:57:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:06.073 00:57:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:06.073 00:57:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:06.073 00:57:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@105 -- # continue 2 00:23:06.073 00:57:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@105 -- # continue 2 00:23:06.073 00:57:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:06.073 00:57:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.073 00:57:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:06.073 00:57:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:06.073 2: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:06.073 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:23:06.073 altname enp24s0f0np0 00:23:06.073 altname ens785f0np0 00:23:06.073 inet 192.168.100.8/24 scope global mlx_0_0 00:23:06.073 valid_lft forever preferred_lft forever 00:23:06.073 00:57:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:06.073 00:57:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.073 00:57:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:06.073 00:57:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:06.073 3: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:06.073 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:23:06.073 altname enp24s0f1np1 00:23:06.073 altname ens785f1np1 00:23:06.073 inet 192.168.100.9/24 scope global mlx_0_1 00:23:06.073 valid_lft forever preferred_lft forever 00:23:06.073 00:57:12 -- nvmf/common.sh@411 -- # return 0 00:23:06.073 00:57:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:06.073 00:57:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:06.073 00:57:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:06.073 00:57:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:06.073 00:57:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:06.073 00:57:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:06.073 00:57:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:06.073 00:57:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:06.073 00:57:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:06.073 00:57:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@105 -- # continue 2 00:23:06.073 00:57:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.073 00:57:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:06.073 00:57:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@105 -- # continue 2 00:23:06.073 00:57:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:06.073 00:57:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.073 00:57:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:06.073 00:57:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.073 00:57:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.073 00:57:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:06.073 192.168.100.9' 00:23:06.073 00:57:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:06.073 192.168.100.9' 00:23:06.073 00:57:12 -- nvmf/common.sh@446 -- # head -n 1 00:23:06.073 00:57:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:06.073 00:57:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:06.073 192.168.100.9' 00:23:06.073 00:57:12 -- nvmf/common.sh@447 -- # tail -n +2 00:23:06.073 00:57:12 -- nvmf/common.sh@447 -- # head -n 1 00:23:06.073 00:57:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:06.073 00:57:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:06.073 00:57:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:06.073 00:57:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:06.073 00:57:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:06.073 00:57:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:06.073 00:57:12 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:23:06.073 00:57:12 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:23:06.073 00:57:12 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:23:06.073 00:57:12 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:23:06.073 00:57:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:06.073 00:57:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:06.073 00:57:12 -- common/autotest_common.sh@10 -- # set +x 00:23:06.073 ************************************ 00:23:06.073 START TEST nvmf_device_removal_pci_remove_no_srq 00:23:06.073 ************************************ 00:23:06.073 00:57:12 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan --no-srq 00:23:06.073 00:57:12 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:23:06.073 00:57:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:06.073 00:57:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:23:06.073 00:57:12 -- common/autotest_common.sh@10 -- # set +x 00:23:06.073 00:57:12 -- nvmf/common.sh@470 -- # nvmfpid=391154 00:23:06.073 00:57:12 -- nvmf/common.sh@471 -- # waitforlisten 391154 00:23:06.073 00:57:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:23:06.073 00:57:12 -- common/autotest_common.sh@817 -- # '[' -z 391154 ']' 00:23:06.073 00:57:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:06.073 00:57:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:06.073 00:57:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:06.073 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:06.073 00:57:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:06.073 00:57:12 -- common/autotest_common.sh@10 -- # set +x 00:23:06.073 [2024-04-26 00:57:12.776074] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:23:06.073 [2024-04-26 00:57:12.776116] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:06.073 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.073 [2024-04-26 00:57:12.824133] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:23:06.073 [2024-04-26 00:57:12.894006] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:06.073 [2024-04-26 00:57:12.894041] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:06.073 [2024-04-26 00:57:12.894048] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:06.073 [2024-04-26 00:57:12.894053] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:06.074 [2024-04-26 00:57:12.894058] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:06.074 [2024-04-26 00:57:12.894089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:06.074 [2024-04-26 00:57:12.894092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:06.644 00:57:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:06.644 00:57:13 -- common/autotest_common.sh@850 -- # return 0 00:23:06.644 00:57:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:06.644 00:57:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:06.645 00:57:13 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:23:06.645 00:57:13 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:23:06.645 00:57:13 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:23:06.645 00:57:13 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 [2024-04-26 00:57:13.599760] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12c22b0/0x12c67a0) succeed. 00:23:06.645 [2024-04-26 00:57:13.607690] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x12c37b0/0x1307e30) succeed. 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:23:06.645 00:57:13 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:06.645 00:57:13 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:06.645 00:57:13 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:06.645 00:57:13 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:06.645 00:57:13 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:06.645 00:57:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.645 00:57:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.645 00:57:13 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:06.645 00:57:13 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:06.645 00:57:13 -- nvmf/common.sh@105 -- # continue 2 00:23:06.645 00:57:13 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:06.645 00:57:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.645 00:57:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:06.645 00:57:13 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:06.645 00:57:13 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:06.645 00:57:13 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:06.645 00:57:13 -- nvmf/common.sh@105 -- # continue 2 00:23:06.645 00:57:13 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:23:06.645 00:57:13 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@25 -- # local -a dev_name 00:23:06.645 00:57:13 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:23:06.645 00:57:13 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.645 00:57:13 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:23:06.645 00:57:13 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:23:06.645 00:57:13 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:23:06.645 00:57:13 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 [2024-04-26 00:57:13.723910] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@41 -- # return 0 00:23:06.645 00:57:13 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:23:06.645 00:57:13 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:23:06.645 00:57:13 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@25 -- # local -a dev_name 00:23:06.645 00:57:13 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:23:06.645 00:57:13 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:06.645 00:57:13 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:06.645 00:57:13 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:23:06.645 00:57:13 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:23:06.645 00:57:13 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:23:06.645 00:57:13 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:23:06.645 00:57:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:06.645 [2024-04-26 00:57:13.798356] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:06.645 00:57:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:06.645 00:57:13 -- target/device_removal.sh@41 -- # return 0 00:23:06.645 00:57:13 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@53 -- # return 0 00:23:06.645 00:57:13 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:23:06.645 00:57:13 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:23:06.645 00:57:13 -- target/device_removal.sh@87 -- # local dev_names 00:23:06.645 00:57:13 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:23:06.645 00:57:13 -- target/device_removal.sh@91 -- # bdevperf_pid=391299 00:23:06.645 00:57:13 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:06.645 00:57:13 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:23:06.645 00:57:13 -- target/device_removal.sh@94 -- # waitforlisten 391299 /var/tmp/bdevperf.sock 00:23:06.645 00:57:13 -- common/autotest_common.sh@817 -- # '[' -z 391299 ']' 00:23:06.645 00:57:13 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:06.645 00:57:13 -- common/autotest_common.sh@822 -- # local max_retries=100 00:23:06.645 00:57:13 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:06.645 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:06.645 00:57:13 -- common/autotest_common.sh@826 -- # xtrace_disable 00:23:06.645 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:23:07.584 00:57:14 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:23:07.584 00:57:14 -- common/autotest_common.sh@850 -- # return 0 00:23:07.584 00:57:14 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:23:07.584 00:57:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:07.584 00:57:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.584 00:57:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:07.584 00:57:14 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:23:07.584 00:57:14 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:23:07.584 00:57:14 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:23:07.584 00:57:14 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:23:07.584 00:57:14 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:23:07.584 00:57:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:07.584 00:57:14 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:23:07.584 00:57:14 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:23:07.584 00:57:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:07.584 00:57:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.584 Nvme_mlx_0_0n1 00:23:07.584 00:57:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:07.584 00:57:14 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:23:07.584 00:57:14 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:23:07.584 00:57:14 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:23:07.584 00:57:14 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:23:07.584 00:57:14 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:23:07.584 00:57:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:07.584 00:57:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:07.584 00:57:14 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:23:07.584 00:57:14 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:23:07.584 00:57:14 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:07.584 00:57:14 -- common/autotest_common.sh@10 -- # set +x 00:23:07.843 Nvme_mlx_0_1n1 00:23:07.843 00:57:14 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:07.843 00:57:14 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=391479 00:23:07.843 00:57:14 -- target/device_removal.sh@112 -- # sleep 5 00:23:07.843 00:57:14 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:23:13.122 00:57:19 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:23:13.122 00:57:19 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:23:13.122 00:57:19 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:23:13.122 00:57:19 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:23:13.122 00:57:19 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:23:13.122 00:57:19 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:13.122 00:57:19 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:13.122 00:57:19 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:13.122 00:57:19 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:13.122 00:57:19 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:23:13.122 00:57:19 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:23:13.122 00:57:19 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:23:13.122 00:57:19 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:23:13.122 00:57:19 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:23:13.122 00:57:19 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:13.122 00:57:19 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:13.122 00:57:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:13.122 00:57:19 -- target/device_removal.sh@77 -- # grep mlx5_0 00:23:13.122 00:57:19 -- common/autotest_common.sh@10 -- # set +x 00:23:13.122 00:57:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:13.122 mlx5_0 00:23:13.122 00:57:19 -- target/device_removal.sh@78 -- # return 0 00:23:13.122 00:57:19 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@67 -- # echo 1 00:23:13.122 00:57:19 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:23:13.122 00:57:19 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:23:13.122 [2024-04-26 00:57:19.957414] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:23:13.122 [2024-04-26 00:57:19.957617] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:13.122 [2024-04-26 00:57:19.961663] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:13.122 [2024-04-26 00:57:19.961680] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 95 00:23:13.122 [2024-04-26 00:57:19.961689] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:23:13.122 [2024-04-26 00:57:19.961695] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961700] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961704] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961709] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961713] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961717] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961722] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961726] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961731] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961735] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:13.122 [2024-04-26 00:57:19.961740] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961744] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961748] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961752] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961757] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961761] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961766] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961771] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961775] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961779] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961783] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961788] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961792] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961797] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961801] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961805] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961809] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961814] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.122 [2024-04-26 00:57:19.961819] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.122 [2024-04-26 00:57:19.961823] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961828] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961833] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961837] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961842] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961847] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961851] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961860] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961865] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961869] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961875] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961880] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961884] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961888] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961892] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961897] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961901] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961905] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961910] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961914] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961918] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961923] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961928] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961932] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961937] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961941] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961946] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961951] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961955] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961959] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961964] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961968] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961972] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961977] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961982] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961986] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961990] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.961995] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.961999] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962003] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962007] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962011] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:13.123 [2024-04-26 00:57:19.962016] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962020] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962024] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962029] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962033] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962038] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962042] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962046] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962051] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962055] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962060] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962064] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962068] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962073] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962078] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962082] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962087] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962091] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962095] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962100] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962105] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962109] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962113] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962118] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962124] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962128] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962133] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962137] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962143] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962147] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962152] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962156] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962161] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962165] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962170] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962175] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962179] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962184] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962188] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962192] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962198] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962202] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962207] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962211] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962219] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962224] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962234] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962248] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962254] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962261] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962266] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962271] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962276] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962281] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962285] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962290] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962295] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962299] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962304] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962308] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962314] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962318] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962322] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962327] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962331] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962335] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962339] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962343] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962348] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962353] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962357] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.123 [2024-04-26 00:57:19.962361] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.123 [2024-04-26 00:57:19.962366] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962370] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962374] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962378] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962383] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962387] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962391] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962395] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962400] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962405] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962409] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962413] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962418] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962422] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962427] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962433] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962438] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962442] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962446] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962451] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962460] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962466] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962470] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962475] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962480] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962484] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962488] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962493] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962497] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962502] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962506] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962510] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962515] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962519] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962523] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962528] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962532] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962536] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962541] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962546] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962550] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962554] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962559] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962563] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:13.124 [2024-04-26 00:57:19.962567] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:23:13.124 [2024-04-26 00:57:19.962571] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:23:18.400 00:57:25 -- target/device_removal.sh@147 -- # seq 1 10 00:23:18.401 00:57:25 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:23:18.401 00:57:25 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:23:18.401 00:57:25 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:23:18.401 00:57:25 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:18.401 00:57:25 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:18.401 00:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.401 00:57:25 -- target/device_removal.sh@77 -- # grep mlx5_0 00:23:18.401 00:57:25 -- common/autotest_common.sh@10 -- # set +x 00:23:18.401 00:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.401 00:57:25 -- target/device_removal.sh@78 -- # return 1 00:23:18.401 00:57:25 -- target/device_removal.sh@149 -- # break 00:23:18.401 00:57:25 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:18.401 00:57:25 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:18.401 00:57:25 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:18.401 00:57:25 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:18.401 00:57:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:18.401 00:57:25 -- common/autotest_common.sh@10 -- # set +x 00:23:18.659 00:57:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:18.659 00:57:25 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:23:18.659 00:57:25 -- target/device_removal.sh@160 -- # rescan_pci 00:23:18.659 00:57:25 -- target/device_removal.sh@57 -- # echo 1 00:23:19.596 [2024-04-26 00:57:26.541791] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x15fb650, err 11. Skip rescan. 00:23:19.854 [2024-04-26 00:57:26.897182] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x12badd0/0x12c67a0) succeed. 00:23:19.854 [2024-04-26 00:57:26.897243] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:23:20.789 00:57:27 -- target/device_removal.sh@162 -- # seq 1 10 00:23:20.789 00:57:27 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:20.789 00:57:27 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:23:20.789 00:57:27 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:23:20.789 00:57:27 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:23:20.789 00:57:27 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:23:20.789 00:57:27 -- target/device_removal.sh@171 -- # break 00:23:20.789 00:57:27 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:23:20.789 00:57:27 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:23:22.697 00:57:29 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:23:22.697 00:57:29 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:22.697 00:57:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:22.697 00:57:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:22.697 00:57:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:22.697 00:57:29 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:22.697 00:57:29 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:23:22.958 00:57:29 -- target/device_removal.sh@186 -- # seq 1 10 00:23:22.958 00:57:29 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:22.958 00:57:29 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:22.958 00:57:29 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:22.958 00:57:29 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:22.958 00:57:29 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:22.958 00:57:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.958 00:57:29 -- common/autotest_common.sh@10 -- # set +x 00:23:22.958 [2024-04-26 00:57:29.907069] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:22.958 [2024-04-26 00:57:29.907099] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:23:22.958 [2024-04-26 00:57:29.907112] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:22.958 [2024-04-26 00:57:29.907123] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:22.958 00:57:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.958 00:57:29 -- target/device_removal.sh@187 -- # ib_count=2 00:23:22.958 00:57:29 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:22.958 00:57:29 -- target/device_removal.sh@189 -- # break 00:23:22.958 00:57:29 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:23:22.958 00:57:29 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:22.958 00:57:29 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:23:22.958 00:57:29 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:23:22.958 00:57:29 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:23:22.958 00:57:29 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:22.958 00:57:29 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:22.958 00:57:29 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:22.958 00:57:29 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:22.958 00:57:29 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:23:22.958 00:57:29 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:22.958 00:57:29 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:22.958 00:57:29 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:23:22.958 00:57:29 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:23:22.958 00:57:29 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:23:22.958 00:57:29 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:22.958 00:57:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:22.958 00:57:29 -- common/autotest_common.sh@10 -- # set +x 00:23:22.958 00:57:29 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:22.958 00:57:29 -- target/device_removal.sh@77 -- # grep mlx5_1 00:23:22.958 00:57:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:22.958 mlx5_1 00:23:22.958 00:57:30 -- target/device_removal.sh@78 -- # return 0 00:23:22.958 00:57:30 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:23:22.958 00:57:30 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:23:22.958 00:57:30 -- target/device_removal.sh@67 -- # echo 1 00:23:22.958 00:57:30 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:23:22.958 00:57:30 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:23:22.958 00:57:30 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:23:22.958 [2024-04-26 00:57:30.061272] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:23:22.958 [2024-04-26 00:57:30.061338] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:22.958 [2024-04-26 00:57:30.069056] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:23:22.958 [2024-04-26 00:57:30.069072] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 24 00:23:22.958 [2024-04-26 00:57:30.069079] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:23:22.958 [2024-04-26 00:57:30.069087] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069094] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069101] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069107] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069113] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069120] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069126] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069132] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069139] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069144] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069151] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069157] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069163] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069169] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069176] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069183] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069189] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069194] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069201] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069207] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069213] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069219] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069226] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069231] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069245] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069252] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069262] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069269] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069278] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069287] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069295] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069304] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069311] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069317] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069323] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069329] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069335] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069341] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069349] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069355] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069361] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069367] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069373] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069379] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069385] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069391] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:22.958 [2024-04-26 00:57:30.069397] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:23:22.958 [2024-04-26 00:57:30.069403] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:23:29.682 00:57:35 -- target/device_removal.sh@147 -- # seq 1 10 00:23:29.682 00:57:35 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:23:29.682 00:57:35 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:23:29.682 00:57:35 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:23:29.682 00:57:35 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:23:29.682 00:57:35 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:23:29.682 00:57:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.682 00:57:35 -- target/device_removal.sh@77 -- # grep mlx5_1 00:23:29.682 00:57:35 -- common/autotest_common.sh@10 -- # set +x 00:23:29.682 00:57:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.682 00:57:35 -- target/device_removal.sh@78 -- # return 1 00:23:29.682 00:57:35 -- target/device_removal.sh@149 -- # break 00:23:29.682 00:57:35 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:29.682 00:57:35 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:29.682 00:57:35 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:29.682 00:57:35 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:29.682 00:57:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:29.682 00:57:35 -- common/autotest_common.sh@10 -- # set +x 00:23:29.682 00:57:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:29.682 00:57:35 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:23:29.682 00:57:35 -- target/device_removal.sh@160 -- # rescan_pci 00:23:29.682 00:57:35 -- target/device_removal.sh@57 -- # echo 1 00:23:30.620 [2024-04-26 00:57:37.550347] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x12c5290, err 11. Skip rescan. 00:23:30.879 [2024-04-26 00:57:37.918808] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x15eb6c0/0x1307e30) succeed. 00:23:30.879 [2024-04-26 00:57:37.918870] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:23:31.818 00:57:38 -- target/device_removal.sh@162 -- # seq 1 10 00:23:31.818 00:57:38 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:23:31.818 00:57:38 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:23:31.818 00:57:38 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:23:31.818 00:57:38 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:23:31.818 00:57:38 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:23:31.818 00:57:38 -- target/device_removal.sh@171 -- # break 00:23:31.818 00:57:38 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:23:31.818 00:57:38 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:23:31.818 00:57:38 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:23:31.818 00:57:38 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:31.818 00:57:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:31.818 00:57:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:31.818 00:57:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:31.818 00:57:38 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:23:31.818 00:57:38 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:23:31.818 00:57:38 -- target/device_removal.sh@186 -- # seq 1 10 00:23:31.818 00:57:38 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:23:31.818 00:57:38 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:23:31.818 00:57:38 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:23:31.818 00:57:38 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:23:31.818 00:57:38 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:23:31.818 00:57:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:23:31.818 00:57:38 -- common/autotest_common.sh@10 -- # set +x 00:23:31.818 [2024-04-26 00:57:38.898259] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:31.818 [2024-04-26 00:57:38.898291] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:23:31.818 [2024-04-26 00:57:38.898304] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:31.818 [2024-04-26 00:57:38.898315] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:23:31.818 00:57:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:23:31.818 00:57:38 -- target/device_removal.sh@187 -- # ib_count=2 00:23:31.818 00:57:38 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:23:31.818 00:57:38 -- target/device_removal.sh@189 -- # break 00:23:31.818 00:57:38 -- target/device_removal.sh@200 -- # stop_bdevperf 00:23:31.818 00:57:38 -- target/device_removal.sh@116 -- # wait 391479 00:24:39.527 0 00:24:39.527 00:58:45 -- target/device_removal.sh@118 -- # killprocess 391299 00:24:39.527 00:58:45 -- common/autotest_common.sh@936 -- # '[' -z 391299 ']' 00:24:39.527 00:58:45 -- common/autotest_common.sh@940 -- # kill -0 391299 00:24:39.527 00:58:45 -- common/autotest_common.sh@941 -- # uname 00:24:39.527 00:58:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:39.527 00:58:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 391299 00:24:39.527 00:58:45 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:24:39.527 00:58:45 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:24:39.527 00:58:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 391299' 00:24:39.527 killing process with pid 391299 00:24:39.527 00:58:45 -- common/autotest_common.sh@955 -- # kill 391299 00:24:39.527 00:58:45 -- common/autotest_common.sh@960 -- # wait 391299 00:24:39.527 00:58:45 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:24:39.527 00:58:45 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:39.527 [2024-04-26 00:57:13.848432] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:24:39.527 [2024-04-26 00:57:13.848476] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid391299 ] 00:24:39.527 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.527 [2024-04-26 00:57:13.894718] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:39.527 [2024-04-26 00:57:13.960069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:39.527 Running I/O for 90 seconds... 00:24:39.527 [2024-04-26 00:57:19.962164] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:39.527 [2024-04-26 00:57:19.962190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.527 [2024-04-26 00:57:19.962199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.527 [2024-04-26 00:57:19.962208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.527 [2024-04-26 00:57:19.962216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.527 [2024-04-26 00:57:19.962227] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.527 [2024-04-26 00:57:19.962236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.527 [2024-04-26 00:57:19.962249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.527 [2024-04-26 00:57:19.962258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.527 [2024-04-26 00:57:19.965548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.527 [2024-04-26 00:57:19.965559] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.527 [2024-04-26 00:57:19.965585] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:39.527 [2024-04-26 00:57:19.972164] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:19.982191] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:19.992216] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.002245] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.012266] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.022726] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.033245] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.043681] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.053983] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.064007] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.074265] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.527 [2024-04-26 00:57:20.084518] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.094720] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.104738] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.114763] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.124846] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.134872] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.144896] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.155558] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.165885] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.176167] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.186628] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.196653] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.206678] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.216704] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.226730] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.236995] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.247644] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.257981] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.268316] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.278627] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.288651] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.298838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.309097] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.319251] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.329274] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.339659] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.350050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.360691] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.370916] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.381064] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.391089] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.401293] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.411319] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.421346] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.432844] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.443209] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.453545] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.463569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.473595] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.483620] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.493647] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.503671] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.513697] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.523722] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.534059] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.544345] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.554777] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.565718] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.575738] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.585763] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.596050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.606322] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.616347] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.626719] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.637065] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.647344] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.657520] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.667855] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.678043] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.688118] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.698206] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.708516] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.718541] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.728567] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.739014] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.749384] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.759753] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.769943] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.779967] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.790111] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.800136] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.810398] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.820423] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.830450] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.840474] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.850501] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.861236] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.871930] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.881956] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.892165] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.902191] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.912216] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.922245] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.932269] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.942294] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.952320] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.962346] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.528 [2024-04-26 00:57:20.967990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:238056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.528 [2024-04-26 00:57:20.968007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.528 [2024-04-26 00:57:20.968020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:238064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:238072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:238080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:238088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:238096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:238104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:238112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:238120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:238128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:238136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:238144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:238152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:238160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:238168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:238176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:238184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:238192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:238200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:238208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:238216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:238224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:238232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:238240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:238248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:238256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:238264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:238272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:238280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:238288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:238296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:238304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:238312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:238320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:238328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:238336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:238344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:238352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:238360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.529 [2024-04-26 00:57:20.968523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:238368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.529 [2024-04-26 00:57:20.968529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:238376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:238384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:238392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:238400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:238408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:238416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:238424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:238432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:238440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:238448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:238456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:238464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:238472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:238480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:238488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:238496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:238504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:238512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:238520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:238528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:238536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:238544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:238552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:238560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:238568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:238576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:238584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.530 [2024-04-26 00:57:20.968881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:237568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:237576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:237584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:237592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:237600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:237608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:237616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:237624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.968988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.968995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:237632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.969002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.969009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:237640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x180b00 00:24:39.530 [2024-04-26 00:57:20.969015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.530 [2024-04-26 00:57:20.969022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:237648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:237656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:237664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:237672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:237680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:237688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:237696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:237704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:237712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:237720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:237728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:237736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:237744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:237752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:237760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:237768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:237776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:237784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:237792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:237800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:237808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:237816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:237824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:237832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:237840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:237848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:237856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:237864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:237872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:237880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:237888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:237896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:237904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:237912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.531 [2024-04-26 00:57:20.969480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:237920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x180b00 00:24:39.531 [2024-04-26 00:57:20.969486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:237928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:237936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:237944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:237952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:237960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:237968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:237976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:237984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:237992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:238000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:238008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:238016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:238024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:238032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.969679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:238040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x180b00 00:24:39.532 [2024-04-26 00:57:20.969684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.981402] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:39.532 [2024-04-26 00:57:20.981415] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:39.532 [2024-04-26 00:57:20.981421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:238048 len:8 PRP1 0x0 PRP2 0x0 00:24:39.532 [2024-04-26 00:57:20.981428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:39.532 [2024-04-26 00:57:20.984492] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.532 [2024-04-26 00:57:20.984735] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.532 [2024-04-26 00:57:20.984747] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.532 [2024-04-26 00:57:20.984755] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.532 [2024-04-26 00:57:20.984775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.532 [2024-04-26 00:57:20.984782] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.532 [2024-04-26 00:57:20.984808] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.532 [2024-04-26 00:57:20.984814] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.532 [2024-04-26 00:57:20.984821] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.532 [2024-04-26 00:57:20.984838] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.532 [2024-04-26 00:57:20.984843] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.532 [2024-04-26 00:57:21.988659] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.532 [2024-04-26 00:57:21.988687] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.532 [2024-04-26 00:57:21.988693] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.532 [2024-04-26 00:57:21.988711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.532 [2024-04-26 00:57:21.988718] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.532 [2024-04-26 00:57:21.988732] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.532 [2024-04-26 00:57:21.988738] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.532 [2024-04-26 00:57:21.988745] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.532 [2024-04-26 00:57:21.988763] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.532 [2024-04-26 00:57:21.988770] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.532 [2024-04-26 00:57:22.991435] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.532 [2024-04-26 00:57:22.991466] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.532 [2024-04-26 00:57:22.991471] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.532 [2024-04-26 00:57:22.991487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.532 [2024-04-26 00:57:22.991494] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.532 [2024-04-26 00:57:22.991515] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.533 [2024-04-26 00:57:22.991522] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.533 [2024-04-26 00:57:22.991529] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.533 [2024-04-26 00:57:22.991548] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.533 [2024-04-26 00:57:22.991554] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.533 [2024-04-26 00:57:24.996381] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.533 [2024-04-26 00:57:24.996414] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.533 [2024-04-26 00:57:24.996434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.533 [2024-04-26 00:57:24.996442] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.533 [2024-04-26 00:57:24.997094] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.533 [2024-04-26 00:57:24.997103] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.533 [2024-04-26 00:57:24.997111] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.533 [2024-04-26 00:57:24.997130] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.533 [2024-04-26 00:57:24.997137] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.533 [2024-04-26 00:57:27.001961] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.533 [2024-04-26 00:57:27.001985] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.533 [2024-04-26 00:57:27.002007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.533 [2024-04-26 00:57:27.002014] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.533 [2024-04-26 00:57:27.002025] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.533 [2024-04-26 00:57:27.002031] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.533 [2024-04-26 00:57:27.002037] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.533 [2024-04-26 00:57:27.002054] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.533 [2024-04-26 00:57:27.002061] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.533 [2024-04-26 00:57:29.006883] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.533 [2024-04-26 00:57:29.006910] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:24:39.533 [2024-04-26 00:57:29.006930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.533 [2024-04-26 00:57:29.006938] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:24:39.533 [2024-04-26 00:57:29.006948] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:24:39.533 [2024-04-26 00:57:29.006955] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:24:39.533 [2024-04-26 00:57:29.006963] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:24:39.533 [2024-04-26 00:57:29.006980] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.533 [2024-04-26 00:57:29.006987] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:24:39.533 [2024-04-26 00:57:30.065165] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:39.533 [2024-04-26 00:57:30.065190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.533 [2024-04-26 00:57:30.065199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.533 [2024-04-26 00:57:30.065207] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.533 [2024-04-26 00:57:30.065216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.533 [2024-04-26 00:57:30.065223] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.533 [2024-04-26 00:57:30.065229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.533 [2024-04-26 00:57:30.065236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:24:39.533 [2024-04-26 00:57:30.065248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32532 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:24:39.533 [2024-04-26 00:57:30.066951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.533 [2024-04-26 00:57:30.066961] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.533 [2024-04-26 00:57:30.066990] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:39.533 [2024-04-26 00:57:30.069594] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:39.533 [2024-04-26 00:57:30.075178] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.085204] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.095230] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.105253] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.115278] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.125303] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.135328] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.145354] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.155380] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.165406] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.175431] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.185457] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.195483] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.205507] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.215533] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.225558] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.235583] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.245608] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.255633] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.265658] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.275684] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.285708] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.295734] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.305758] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.315785] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.325810] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.335837] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.345864] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.355888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.365915] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.375941] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.385965] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.395992] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.406017] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.416043] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.426068] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.436095] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.446119] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.456144] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.466171] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.476198] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.486223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.496247] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.506272] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.516298] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.533 [2024-04-26 00:57:30.526323] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.536347] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.546371] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.556397] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.566423] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.576449] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.586475] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.596501] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.606527] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.616551] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.626577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.636604] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.646629] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.656653] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.666677] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.676703] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.686727] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.696752] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.706779] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.716806] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.726831] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.736858] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.746884] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.756909] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.766935] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.776961] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.786985] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.797012] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.807036] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.817062] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.827086] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.837110] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.847137] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.857164] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.867188] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.877213] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.887243] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.897265] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.907292] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.917317] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.927342] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.937368] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.947394] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.957419] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.967445] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.977470] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.987496] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:30.997522] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.007547] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.017573] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.028171] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.038324] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.048349] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.058415] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.068440] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.534 [2024-04-26 00:57:31.069638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:118288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:118352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.534 [2024-04-26 00:57:31.069847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:118400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1beb00 00:24:39.534 [2024-04-26 00:57:31.069854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:118424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:118432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.069986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.069994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:118504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:118520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:118552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:118568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:118576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:118584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:118592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:118600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:118648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.535 [2024-04-26 00:57:31.070337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:118688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1beb00 00:24:39.535 [2024-04-26 00:57:31.070343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:118720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:118760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:118768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1beb00 00:24:39.536 [2024-04-26 00:57:31.070491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:118792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:118800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:118808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:118824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:118848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:118856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:118864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:118880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:118888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:118896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:118904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:118912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:118920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:118928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:118936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.536 [2024-04-26 00:57:31.070768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.536 [2024-04-26 00:57:31.070775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:118952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:118968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:118976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:118984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:118992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:119000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:119008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:119016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:119024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:119032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:119048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:119080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.070990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.070997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:119088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:119104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:119112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:119152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:119160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:119176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:119192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:119224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:119232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:119256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.537 [2024-04-26 00:57:31.071280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.537 [2024-04-26 00:57:31.071287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:119264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.538 [2024-04-26 00:57:31.071293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.071300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:119272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.538 [2024-04-26 00:57:31.071306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.071313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:119280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.538 [2024-04-26 00:57:31.071318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.071326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:119288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.538 [2024-04-26 00:57:31.071332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.071339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:119296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:24:39.538 [2024-04-26 00:57:31.071344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32532 cdw0:a14bf400 sqhd:4530 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.083054] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:24:39.538 [2024-04-26 00:57:31.083066] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:24:39.538 [2024-04-26 00:57:31.083071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:119304 len:8 PRP1 0x0 PRP2 0x0 00:24:39.538 [2024-04-26 00:57:31.083078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:39.538 [2024-04-26 00:57:31.083121] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:31.085553] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.538 [2024-04-26 00:57:31.085570] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:31.085574] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:31.085587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:31.085595] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:31.085647] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:31.085655] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:31.085665] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:31.085681] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:31.085687] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:32.091114] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.538 [2024-04-26 00:57:32.091145] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:32.091151] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:32.091167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:32.091174] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:32.091196] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:32.091202] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:32.091209] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:32.091229] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:32.091235] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:33.094129] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:24:39.538 [2024-04-26 00:57:33.094158] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:33.094164] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:33.094180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:33.094189] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:33.094199] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:33.094205] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:33.094212] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:33.094230] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:33.094237] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:35.100468] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:35.100502] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:35.100524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:35.100532] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:35.100540] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:24:39.538 [2024-04-26 00:57:35.102166] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:35.102188] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:35.102195] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:35.102230] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:35.102262] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:36.105412] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:36.105442] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:36.105463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:36.105470] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:36.106250] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:36.106261] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:36.106269] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:36.106298] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:39.538 [2024-04-26 00:57:36.107085] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:36.107096] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:38.115661] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:24:39.538 [2024-04-26 00:57:38.115692] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:24:39.538 [2024-04-26 00:57:38.115715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:24:39.538 [2024-04-26 00:57:38.115722] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:24:39.538 [2024-04-26 00:57:38.117846] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:24:39.538 [2024-04-26 00:57:38.117863] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:24:39.538 [2024-04-26 00:57:38.117870] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:24:39.538 [2024-04-26 00:57:38.117916] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:39.538 [2024-04-26 00:57:38.117923] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:24:39.538 [2024-04-26 00:57:39.365130] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:39.538 00:24:39.538 Latency(us) 00:24:39.538 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:39.538 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:39.538 Verification LBA range: start 0x0 length 0x8000 00:24:39.538 Nvme_mlx_0_0n1 : 90.01 11811.14 46.14 0.00 0.00 10815.94 1856.85 11035679.86 00:24:39.538 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:24:39.538 Verification LBA range: start 0x0 length 0x8000 00:24:39.538 Nvme_mlx_0_1n1 : 90.01 10658.08 41.63 0.00 0.00 11988.70 2220.94 10041474.47 00:24:39.538 =================================================================================================================== 00:24:39.538 Total : 22469.21 87.77 0.00 0.00 11372.23 1856.85 11035679.86 00:24:39.538 Received shutdown signal, test time was about 90.000000 seconds 00:24:39.538 00:24:39.538 Latency(us) 00:24:39.538 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:39.538 =================================================================================================================== 00:24:39.538 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:39.538 00:58:45 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:24:39.538 00:58:45 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:24:39.538 00:58:45 -- target/device_removal.sh@202 -- # killprocess 391154 00:24:39.538 00:58:45 -- common/autotest_common.sh@936 -- # '[' -z 391154 ']' 00:24:39.538 00:58:45 -- common/autotest_common.sh@940 -- # kill -0 391154 00:24:39.538 00:58:45 -- common/autotest_common.sh@941 -- # uname 00:24:39.539 00:58:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:39.539 00:58:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 391154 00:24:39.539 00:58:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:39.539 00:58:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:39.539 00:58:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 391154' 00:24:39.539 killing process with pid 391154 00:24:39.539 00:58:45 -- common/autotest_common.sh@955 -- # kill 391154 00:24:39.539 00:58:45 -- common/autotest_common.sh@960 -- # wait 391154 00:24:39.539 [2024-04-26 00:58:45.497124] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:24:39.539 00:58:45 -- target/device_removal.sh@203 -- # nvmfpid= 00:24:39.539 00:58:45 -- target/device_removal.sh@205 -- # return 0 00:24:39.539 00:24:39.539 real 1m33.047s 00:24:39.539 user 4m27.327s 00:24:39.539 sys 0m5.519s 00:24:39.539 00:58:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:24:39.539 00:58:45 -- common/autotest_common.sh@10 -- # set +x 00:24:39.539 ************************************ 00:24:39.539 END TEST nvmf_device_removal_pci_remove_no_srq 00:24:39.539 ************************************ 00:24:39.539 00:58:45 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:24:39.539 00:58:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:39.539 00:58:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:39.539 00:58:45 -- common/autotest_common.sh@10 -- # set +x 00:24:39.539 ************************************ 00:24:39.539 START TEST nvmf_device_removal_pci_remove 00:24:39.539 ************************************ 00:24:39.539 00:58:45 -- common/autotest_common.sh@1111 -- # test_remove_and_rescan 00:24:39.539 00:58:45 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:24:39.539 00:58:45 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:24:39.539 00:58:45 -- common/autotest_common.sh@710 -- # xtrace_disable 00:24:39.539 00:58:45 -- common/autotest_common.sh@10 -- # set +x 00:24:39.539 00:58:45 -- nvmf/common.sh@470 -- # nvmfpid=407690 00:24:39.539 00:58:45 -- nvmf/common.sh@471 -- # waitforlisten 407690 00:24:39.539 00:58:45 -- common/autotest_common.sh@817 -- # '[' -z 407690 ']' 00:24:39.539 00:58:45 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:39.539 00:58:45 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:39.539 00:58:45 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:39.539 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:39.539 00:58:45 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:39.539 00:58:45 -- common/autotest_common.sh@10 -- # set +x 00:24:39.539 00:58:45 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:24:39.539 [2024-04-26 00:58:45.949736] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:24:39.539 [2024-04-26 00:58:45.949773] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:39.539 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.539 [2024-04-26 00:58:45.998842] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:24:39.539 [2024-04-26 00:58:46.069834] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:39.539 [2024-04-26 00:58:46.069870] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:39.539 [2024-04-26 00:58:46.069876] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:24:39.539 [2024-04-26 00:58:46.069882] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:24:39.539 [2024-04-26 00:58:46.069887] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:39.539 [2024-04-26 00:58:46.069930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:39.539 [2024-04-26 00:58:46.069932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:39.799 00:58:46 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:39.799 00:58:46 -- common/autotest_common.sh@850 -- # return 0 00:24:39.799 00:58:46 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:24:39.799 00:58:46 -- common/autotest_common.sh@716 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 00:58:46 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:39.799 00:58:46 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:24:39.799 00:58:46 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:24:39.799 00:58:46 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:24:39.799 00:58:46 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:24:39.799 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 [2024-04-26 00:58:46.776046] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21ab2b0/0x21af7a0) succeed. 00:24:39.799 [2024-04-26 00:58:46.784292] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21ac7b0/0x21f0e30) succeed. 00:24:39.799 00:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.799 00:58:46 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:24:39.799 00:58:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:24:39.799 00:58:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:24:39.799 00:58:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:24:39.799 00:58:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:24:39.799 00:58:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:24:39.799 00:58:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:39.799 00:58:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:39.799 00:58:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:24:39.799 00:58:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:24:39.799 00:58:46 -- nvmf/common.sh@105 -- # continue 2 00:24:39.799 00:58:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:24:39.799 00:58:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:39.799 00:58:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:24:39.799 00:58:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:24:39.799 00:58:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:24:39.799 00:58:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:24:39.799 00:58:46 -- nvmf/common.sh@105 -- # continue 2 00:24:39.799 00:58:46 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:39.799 00:58:46 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:39.799 00:58:46 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:24:39.799 00:58:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:39.799 00:58:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:39.799 00:58:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:39.799 00:58:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:39.799 00:58:46 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:24:39.799 00:58:46 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:24:39.799 00:58:46 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:39.799 00:58:46 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:39.799 00:58:46 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:24:39.799 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 00:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.799 00:58:46 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:24:39.799 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 00:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.799 00:58:46 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:24:39.799 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 00:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.799 00:58:46 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:24:39.799 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.799 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:39.799 [2024-04-26 00:58:46.956537] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:39.799 00:58:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:39.799 00:58:46 -- target/device_removal.sh@41 -- # return 0 00:24:39.800 00:58:46 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:24:39.800 00:58:46 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:24:39.800 00:58:46 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@25 -- # local -a dev_name 00:24:39.800 00:58:46 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:24:39.800 00:58:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:39.800 00:58:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:39.800 00:58:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:39.800 00:58:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:39.800 00:58:46 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:24:39.800 00:58:46 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:24:39.800 00:58:46 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:24:39.800 00:58:46 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:24:39.800 00:58:46 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:24:39.800 00:58:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:39.800 00:58:46 -- common/autotest_common.sh@10 -- # set +x 00:24:40.059 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.059 00:58:47 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:24:40.059 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.059 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.059 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.059 00:58:47 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:24:40.059 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.059 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.059 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.059 00:58:47 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:24:40.059 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.060 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.060 [2024-04-26 00:58:47.026373] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:24:40.060 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.060 00:58:47 -- target/device_removal.sh@41 -- # return 0 00:24:40.060 00:58:47 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:24:40.060 00:58:47 -- target/device_removal.sh@53 -- # return 0 00:24:40.060 00:58:47 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:24:40.060 00:58:47 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:24:40.060 00:58:47 -- target/device_removal.sh@87 -- # local dev_names 00:24:40.060 00:58:47 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:24:40.060 00:58:47 -- target/device_removal.sh@91 -- # bdevperf_pid=407984 00:24:40.060 00:58:47 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:40.060 00:58:47 -- target/device_removal.sh@94 -- # waitforlisten 407984 /var/tmp/bdevperf.sock 00:24:40.060 00:58:47 -- common/autotest_common.sh@817 -- # '[' -z 407984 ']' 00:24:40.060 00:58:47 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:40.060 00:58:47 -- common/autotest_common.sh@822 -- # local max_retries=100 00:24:40.060 00:58:47 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:40.060 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:40.060 00:58:47 -- common/autotest_common.sh@826 -- # xtrace_disable 00:24:40.060 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.060 00:58:47 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:24:40.999 00:58:47 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:24:40.999 00:58:47 -- common/autotest_common.sh@850 -- # return 0 00:24:40.999 00:58:47 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:24:40.999 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.999 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.999 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.999 00:58:47 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:40.999 00:58:47 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:24:40.999 00:58:47 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:24:40.999 00:58:47 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:24:40.999 00:58:47 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:24:40.999 00:58:47 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:40.999 00:58:47 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:24:40.999 00:58:47 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:24:40.999 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.999 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.999 Nvme_mlx_0_0n1 00:24:40.999 00:58:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.999 00:58:47 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:24:40.999 00:58:47 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:24:40.999 00:58:47 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:24:40.999 00:58:47 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:24:40.999 00:58:47 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:24:40.999 00:58:47 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:40.999 00:58:47 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:40.999 00:58:47 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:24:40.999 00:58:47 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:24:40.999 00:58:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:40.999 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:24:40.999 Nvme_mlx_0_1n1 00:24:40.999 00:58:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:40.999 00:58:48 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=408254 00:24:40.999 00:58:48 -- target/device_removal.sh@112 -- # sleep 5 00:24:40.999 00:58:48 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:24:46.277 00:58:53 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:46.277 00:58:53 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:46.277 00:58:53 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:24:46.277 00:58:53 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:24:46.277 00:58:53 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:24:46.277 00:58:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:46.277 00:58:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:46.277 00:58:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:46.277 00:58:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:46.277 00:58:53 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:24:46.277 00:58:53 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:46.277 00:58:53 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:24:46.277 00:58:53 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:24:46.277 00:58:53 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:24:46.277 00:58:53 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:46.277 00:58:53 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:46.277 00:58:53 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:46.277 00:58:53 -- target/device_removal.sh@77 -- # grep mlx5_0 00:24:46.277 00:58:53 -- common/autotest_common.sh@10 -- # set +x 00:24:46.277 00:58:53 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:46.277 mlx5_0 00:24:46.277 00:58:53 -- target/device_removal.sh@78 -- # return 0 00:24:46.277 00:58:53 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@67 -- # echo 1 00:24:46.277 00:58:53 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:24:46.277 00:58:53 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:24:46.277 [2024-04-26 00:58:53.193798] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:24:46.277 [2024-04-26 00:58:53.193950] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:46.277 [2024-04-26 00:58:53.198234] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:46.277 [2024-04-26 00:58:53.198264] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 95 00:24:51.576 00:58:58 -- target/device_removal.sh@147 -- # seq 1 10 00:24:51.576 00:58:58 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:24:51.576 00:58:58 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:24:51.576 00:58:58 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:24:51.576 00:58:58 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:51.576 00:58:58 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:51.576 00:58:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.576 00:58:58 -- target/device_removal.sh@77 -- # grep mlx5_0 00:24:51.576 00:58:58 -- common/autotest_common.sh@10 -- # set +x 00:24:51.576 00:58:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.576 00:58:58 -- target/device_removal.sh@78 -- # return 1 00:24:51.576 00:58:58 -- target/device_removal.sh@149 -- # break 00:24:51.576 00:58:58 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:51.576 00:58:58 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:51.576 00:58:58 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:51.576 00:58:58 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:51.576 00:58:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:51.576 00:58:58 -- common/autotest_common.sh@10 -- # set +x 00:24:51.576 00:58:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:51.576 00:58:58 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:24:51.576 00:58:58 -- target/device_removal.sh@160 -- # rescan_pci 00:24:51.576 00:58:58 -- target/device_removal.sh@57 -- # echo 1 00:24:52.514 [2024-04-26 00:58:59.656878] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x2288680, err 11. Skip rescan. 00:24:53.083 [2024-04-26 00:59:00.141229] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21adf40/0x21af7a0) succeed. 00:24:53.083 [2024-04-26 00:59:00.141292] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:24:54.021 00:59:00 -- target/device_removal.sh@162 -- # seq 1 10 00:24:54.021 00:59:00 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:24:54.021 00:59:00 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:24:54.021 00:59:00 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:24:54.021 00:59:00 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:24:54.021 00:59:00 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:24:54.021 00:59:00 -- target/device_removal.sh@171 -- # break 00:24:54.021 00:59:00 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:24:54.021 00:59:00 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:24:55.931 00:59:02 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:24:55.931 00:59:02 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:24:55.931 00:59:02 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:24:55.931 00:59:02 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:55.931 00:59:02 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:55.931 00:59:02 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:24:55.931 00:59:02 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:24:55.931 00:59:03 -- target/device_removal.sh@186 -- # seq 1 10 00:24:55.931 00:59:03 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:24:55.931 00:59:03 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:24:55.931 00:59:03 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:24:55.931 00:59:03 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:24:55.931 00:59:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:55.931 00:59:03 -- common/autotest_common.sh@10 -- # set +x 00:24:55.931 00:59:03 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:24:55.931 [2024-04-26 00:59:03.012813] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:24:55.931 [2024-04-26 00:59:03.012841] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:24:55.931 [2024-04-26 00:59:03.012857] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:55.931 [2024-04-26 00:59:03.012867] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:24:55.931 00:59:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:55.931 00:59:03 -- target/device_removal.sh@187 -- # ib_count=2 00:24:55.931 00:59:03 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:24:55.931 00:59:03 -- target/device_removal.sh@189 -- # break 00:24:55.931 00:59:03 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:24:55.931 00:59:03 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:55.931 00:59:03 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:24:55.931 00:59:03 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:24:55.931 00:59:03 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:24:55.931 00:59:03 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:24:55.931 00:59:03 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:24:55.931 00:59:03 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:24:55.931 00:59:03 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:24:55.931 00:59:03 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:24:55.931 00:59:03 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:55.931 00:59:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:55.931 00:59:03 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:24:55.931 00:59:03 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:24:55.931 00:59:03 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:24:55.931 00:59:03 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:24:55.931 00:59:03 -- target/device_removal.sh@77 -- # grep mlx5_1 00:24:55.931 00:59:03 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:24:55.931 00:59:03 -- common/autotest_common.sh@549 -- # xtrace_disable 00:24:55.931 00:59:03 -- common/autotest_common.sh@10 -- # set +x 00:24:55.931 00:59:03 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:24:56.189 mlx5_1 00:24:56.189 00:59:03 -- target/device_removal.sh@78 -- # return 0 00:24:56.189 00:59:03 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:24:56.189 00:59:03 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:24:56.189 00:59:03 -- target/device_removal.sh@67 -- # echo 1 00:24:56.189 00:59:03 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:24:56.189 00:59:03 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:24:56.189 00:59:03 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:24:56.189 [2024-04-26 00:59:03.178051] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:24:56.189 [2024-04-26 00:59:03.178117] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:56.189 [2024-04-26 00:59:03.187691] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:24:56.189 [2024-04-26 00:59:03.187704] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 63 00:25:02.747 00:59:08 -- target/device_removal.sh@147 -- # seq 1 10 00:25:02.747 00:59:08 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:25:02.747 00:59:08 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:25:02.747 00:59:08 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:25:02.747 00:59:08 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:25:02.747 00:59:08 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:25:02.747 00:59:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:02.747 00:59:08 -- target/device_removal.sh@77 -- # grep mlx5_1 00:25:02.747 00:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:02.747 00:59:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:02.747 00:59:08 -- target/device_removal.sh@78 -- # return 1 00:25:02.747 00:59:08 -- target/device_removal.sh@149 -- # break 00:25:02.747 00:59:08 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:25:02.747 00:59:08 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:25:02.747 00:59:08 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:25:02.747 00:59:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:02.747 00:59:08 -- common/autotest_common.sh@10 -- # set +x 00:25:02.747 00:59:08 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:25:02.747 00:59:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:02.747 00:59:08 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:25:02.747 00:59:08 -- target/device_removal.sh@160 -- # rescan_pci 00:25:02.747 00:59:08 -- target/device_removal.sh@57 -- # echo 1 00:25:03.681 [2024-04-26 00:59:10.571916] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x2197050, err 11. Skip rescan. 00:25:03.940 [2024-04-26 00:59:10.925666] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21ae5c0/0x21f0e30) succeed. 00:25:03.940 [2024-04-26 00:59:10.925732] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:25:04.873 00:59:11 -- target/device_removal.sh@162 -- # seq 1 10 00:25:04.873 00:59:11 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:25:04.873 00:59:11 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:25:04.873 00:59:11 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:25:04.873 00:59:11 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:25:04.873 00:59:11 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:25:04.873 00:59:11 -- target/device_removal.sh@171 -- # break 00:25:04.873 00:59:11 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:25:04.873 00:59:11 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:25:04.873 00:59:11 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:25:04.873 00:59:11 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:25:04.873 00:59:11 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:25:04.873 00:59:11 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:25:04.873 00:59:11 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:25:04.873 00:59:11 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:25:04.873 00:59:11 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:25:04.873 00:59:11 -- target/device_removal.sh@186 -- # seq 1 10 00:25:04.873 00:59:11 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:25:04.873 00:59:11 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:25:04.873 00:59:11 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:25:04.873 00:59:11 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:25:04.873 00:59:11 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:25:04.873 00:59:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:25:04.873 00:59:11 -- common/autotest_common.sh@10 -- # set +x 00:25:04.873 [2024-04-26 00:59:11.958192] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:25:04.873 [2024-04-26 00:59:11.958228] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:25:04.873 [2024-04-26 00:59:11.958250] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:25:04.873 [2024-04-26 00:59:11.958262] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:25:04.873 00:59:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:25:04.873 00:59:11 -- target/device_removal.sh@187 -- # ib_count=2 00:25:04.873 00:59:11 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:25:04.873 00:59:11 -- target/device_removal.sh@189 -- # break 00:25:04.873 00:59:11 -- target/device_removal.sh@200 -- # stop_bdevperf 00:25:04.873 00:59:11 -- target/device_removal.sh@116 -- # wait 408254 00:26:12.546 0 00:26:12.546 01:00:18 -- target/device_removal.sh@118 -- # killprocess 407984 00:26:12.546 01:00:18 -- common/autotest_common.sh@936 -- # '[' -z 407984 ']' 00:26:12.546 01:00:18 -- common/autotest_common.sh@940 -- # kill -0 407984 00:26:12.546 01:00:18 -- common/autotest_common.sh@941 -- # uname 00:26:12.546 01:00:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.546 01:00:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 407984 00:26:12.546 01:00:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:26:12.546 01:00:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:26:12.546 01:00:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 407984' 00:26:12.546 killing process with pid 407984 00:26:12.546 01:00:18 -- common/autotest_common.sh@955 -- # kill 407984 00:26:12.546 01:00:18 -- common/autotest_common.sh@960 -- # wait 407984 00:26:12.546 01:00:18 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:26:12.546 01:00:18 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:26:12.546 [2024-04-26 00:58:47.073981] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:12.546 [2024-04-26 00:58:47.074023] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid407984 ] 00:26:12.546 EAL: No free 2048 kB hugepages reported on node 1 00:26:12.546 [2024-04-26 00:58:47.119751] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:12.546 [2024-04-26 00:58:47.184145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:12.546 Running I/O for 90 seconds... 00:26:12.546 [2024-04-26 00:58:53.195288] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:26:12.546 [2024-04-26 00:58:53.195319] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.546 [2024-04-26 00:58:53.195328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.546 [2024-04-26 00:58:53.195336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.546 [2024-04-26 00:58:53.195342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.546 [2024-04-26 00:58:53.195349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.546 [2024-04-26 00:58:53.195355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.546 [2024-04-26 00:58:53.195362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.546 [2024-04-26 00:58:53.195368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.546 [2024-04-26 00:58:53.197186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.546 [2024-04-26 00:58:53.197199] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.546 [2024-04-26 00:58:53.197219] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:26:12.546 [2024-04-26 00:58:53.206651] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.216672] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.226902] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.237619] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.248109] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.258385] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.268410] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.278435] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.288458] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.298697] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.308971] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.318997] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.329357] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.340126] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.546 [2024-04-26 00:58:53.350606] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.361945] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.371969] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.381994] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.392020] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.402045] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.412196] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.422222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.432577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.443338] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.453975] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.464130] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.474321] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.484775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.494955] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.505007] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.515222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.525504] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.535527] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.545552] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.557644] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.568183] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.578345] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.588361] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.598386] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.608412] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.618714] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.628890] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.638916] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.649120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.659146] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.669175] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.679707] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.689765] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.701698] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.711787] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.721905] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.731930] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.741955] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.751978] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.762004] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.772028] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.782055] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.792080] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.802636] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.813128] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.823680] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.834163] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.844261] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.854513] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.864538] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.874568] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.884599] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.894625] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.904653] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.915097] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.925816] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.936326] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.946762] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.957201] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.967226] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.977490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.987514] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:53.997539] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.007841] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.018120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.028144] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.038246] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.048261] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.058875] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.069323] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.079838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.090198] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.100223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.110252] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.120276] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.130301] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.140326] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.150356] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.160382] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.170408] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.180893] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.191288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.547 [2024-04-26 00:58:54.199623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:246848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ee000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:246856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ec000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:246864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ea000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:246872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e8000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:246880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e6000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:246888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e4000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:246896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e2000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:246904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077e0000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:246912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077de000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:246920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077dc000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:246928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077da000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:246936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d8000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:246944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d6000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:246952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d4000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:246960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d2000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:246968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077d0000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:246976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ce000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:246984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077cc000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:246992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ca000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:247000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c8000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:247008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c6000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:247016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c4000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:247024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c2000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:247032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077c0000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:247040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077be000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.199992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:247048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077bc000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.199998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:247056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ba000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:247064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b8000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:247072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b6000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:247080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b4000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:247088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b2000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:247096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077b0000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:247104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ae000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:247112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077ac000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:247120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077aa000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.547 [2024-04-26 00:58:54.200135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:247128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a8000 len:0x1000 key:0x1810ef 00:26:12.547 [2024-04-26 00:58:54.200141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:247136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a6000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:247144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a4000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:247152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a2000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:247160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000077a0000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:247168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:247176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:247184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000779a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:247192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007798000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:247200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007796000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:247208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007794000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:247216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007792000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:247224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007790000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:247232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:247240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:247248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000778a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:247256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007788000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:247264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007786000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:247272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007784000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:247280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007782000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:247288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007780000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:247296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:247304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:247312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:247320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:247328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:247336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:247344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:247352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:247360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:247368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:247376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:247384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:247392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:247400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:247408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:247416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:247424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:247432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:247440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:247448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:247456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:247464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:247472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:247480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:247488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:247496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:247504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:247512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:247520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:247528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:247536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:247544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:247552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:247560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:247568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:247576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:247584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:247592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:247600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:247608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:247616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:247624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.200991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.200998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:247632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.201011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:247640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.201024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:247648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.201037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:247656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.201051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:247664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.548 [2024-04-26 00:58:54.201065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:247672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x1810ef 00:26:12.548 [2024-04-26 00:58:54.201071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:247680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:247688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:247696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:247704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:247712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:247720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:247728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:247736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:247744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:247752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.201213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:247760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.201219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:247768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.209217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:247776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.209233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:247784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.209250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:247792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.209264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:247800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x1810ef 00:26:12.549 [2024-04-26 00:58:54.209278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:247808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:247816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:247824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:247832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:247840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:247848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.209367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:247856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.549 [2024-04-26 00:58:54.209373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.221087] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:12.549 [2024-04-26 00:58:54.221099] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:12.549 [2024-04-26 00:58:54.221107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:247864 len:8 PRP1 0x0 PRP2 0x0 00:26:12.549 [2024-04-26 00:58:54.221115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:58:54.224194] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:58:54.224434] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.549 [2024-04-26 00:58:54.224448] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:58:54.224453] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:58:54.224467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:58:54.224475] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:58:54.224501] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:58:54.224507] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:58:54.224514] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:58:54.224531] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:58:54.224537] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:58:55.226986] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.549 [2024-04-26 00:58:55.227016] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:58:55.227023] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:58:55.227040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:58:55.227047] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:58:55.227056] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:58:55.227062] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:58:55.227069] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:58:55.227367] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:58:55.227381] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:58:56.232122] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.549 [2024-04-26 00:58:56.232153] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:58:56.232160] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:58:56.232175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:58:56.232183] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:58:56.232199] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:58:56.232205] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:58:56.232212] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:58:56.232230] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:58:56.232237] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:58:58.238580] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:58:58.238613] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:58:58.238634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:58:58.238641] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:58:58.239373] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:58:58.239382] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:58:58.239389] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:58:58.239424] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:58:58.239431] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:59:00.244340] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:59:00.244373] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:59:00.244397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:59:00.244405] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:59:00.244416] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:59:00.244423] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:59:00.244430] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:59:00.244449] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:59:00.244456] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:59:02.249281] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.549 [2024-04-26 00:59:02.249314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:26:12.549 [2024-04-26 00:59:02.249334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:59:02.249341] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:26:12.549 [2024-04-26 00:59:02.249351] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:26:12.549 [2024-04-26 00:59:02.249357] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:26:12.549 [2024-04-26 00:59:02.249364] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:26:12.549 [2024-04-26 00:59:02.249382] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.549 [2024-04-26 00:59:02.249389] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:26:12.549 [2024-04-26 00:59:03.175672] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:26:12.549 [2024-04-26 00:59:03.175701] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.549 [2024-04-26 00:59:03.175709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:59:03.175717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.549 [2024-04-26 00:59:03.175724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:59:03.175730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.549 [2024-04-26 00:59:03.175736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:59:03.175742] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:12.549 [2024-04-26 00:59:03.175747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32669 cdw0:16 sqhd:13b9 p:0 m:0 dnr:0 00:26:12.549 [2024-04-26 00:59:03.187420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.549 [2024-04-26 00:59:03.187441] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.549 [2024-04-26 00:59:03.187466] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:26:12.549 [2024-04-26 00:59:03.187532] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.197542] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.207566] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.217590] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.227616] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.237641] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.247667] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.257694] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.267718] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.280927] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.287553] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:12.549 [2024-04-26 00:59:03.290926] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.300948] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.310968] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.320994] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.331021] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.341045] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.351070] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.361094] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.549 [2024-04-26 00:59:03.371120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.381146] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.391172] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.401198] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.411222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.421248] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.431274] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.441299] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.451325] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.461351] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.471377] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.481402] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.491429] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.501455] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.511482] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.521509] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.531534] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.541561] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.551586] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.561613] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.571640] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.581665] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.591691] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.601715] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.611741] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.621765] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.631791] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.641818] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.651842] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.661866] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.671892] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.681918] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.691942] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.701967] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.711990] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.722016] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.732043] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.742069] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.752095] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.762120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.772147] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.782172] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.792198] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.802223] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.812250] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.822276] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.832300] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.842325] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.852352] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.862378] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.872402] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.882427] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.892452] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.902478] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.912504] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.922529] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.932555] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.942580] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.952606] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.962630] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.972655] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.982679] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:03.992704] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.002730] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.012755] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.022780] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.032808] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.042834] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.052859] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.062884] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.072911] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.082938] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.092962] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.102987] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.113013] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.123040] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.133066] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.143092] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.153119] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.163145] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.173170] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.183195] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:12.550 [2024-04-26 00:59:04.189868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:110656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:110664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:110672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:110680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:110688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:110696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:110704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.189989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:110712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.189995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:110720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:110728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:110736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:110744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:110752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:110760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:110768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:110776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:110784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:110792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:110800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:110808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:110816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:110824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:110832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:110840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:110848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:110856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:110864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:110872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:110880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:110888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:110896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:110904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:110912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:110920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:110928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:110936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:110944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:110952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.550 [2024-04-26 00:59:04.190472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:110960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.550 [2024-04-26 00:59:04.190478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:110968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:110976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:110984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:110992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:111000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:111008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:111016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:111024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:111032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:111040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:111048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:111056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:111064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:111072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:111080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:111088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:111096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:111104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:111112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:111120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:111128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:111136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:111144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:111152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:111160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.190849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:111168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:12.551 [2024-04-26 00:59:04.190855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32669 cdw0:52cfdcb0 sqhd:e530 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.202522] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:26:12.551 [2024-04-26 00:59:04.202570] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:12.551 [2024-04-26 00:59:04.202577] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:12.551 [2024-04-26 00:59:04.202583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:111176 len:8 PRP1 0x0 PRP2 0x0 00:26:12.551 [2024-04-26 00:59:04.202589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.202596] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:12.551 [2024-04-26 00:59:04.202601] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:12.551 [2024-04-26 00:59:04.202606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:111184 len:8 PRP1 0x0 PRP2 0x0 00:26:12.551 [2024-04-26 00:59:04.202611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:12.551 [2024-04-26 00:59:04.202650] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:04.202848] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.551 [2024-04-26 00:59:04.202858] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:04.202863] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:04.202875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:04.202882] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:04.202891] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:04.202899] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:04.202905] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:04.202920] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:04.202925] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:05.207566] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.551 [2024-04-26 00:59:05.207600] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:05.207606] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:05.207622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:05.207630] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:05.207653] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:05.207659] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:05.207666] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:05.207685] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:05.207692] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:06.210146] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:26:12.551 [2024-04-26 00:59:06.210177] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:06.210184] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:06.210200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:06.210208] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:06.210218] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:06.210225] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:06.210232] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:06.210258] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:06.210265] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:08.215993] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:08.216026] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:08.216048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:08.216056] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:08.216070] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:26:12.551 [2024-04-26 00:59:08.216096] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:08.216107] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:08.216114] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:08.216142] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:08.216165] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:09.218588] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:09.218618] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:09.218639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:09.218646] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:09.218657] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:09.218664] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:09.218671] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:09.218698] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:09.218705] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:11.225636] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:11.225668] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:11.225691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:11.225698] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:11.225711] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:26:12.551 [2024-04-26 00:59:11.225726] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:11.225732] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:11.225740] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:11.225768] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:11.225798] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:12.228232] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:26:12.551 [2024-04-26 00:59:12.228262] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:26:12.551 [2024-04-26 00:59:12.228284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:26:12.551 [2024-04-26 00:59:12.228292] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:26:12.551 [2024-04-26 00:59:12.228302] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:26:12.551 [2024-04-26 00:59:12.228309] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:26:12.551 [2024-04-26 00:59:12.228320] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:26:12.551 [2024-04-26 00:59:12.228643] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:12.551 [2024-04-26 00:59:12.228652] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:26:12.551 [2024-04-26 00:59:13.284536] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:12.551 00:26:12.551 Latency(us) 00:26:12.551 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:12.551 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:26:12.551 Verification LBA range: start 0x0 length 0x8000 00:26:12.551 Nvme_mlx_0_0n1 : 90.01 11878.10 46.40 0.00 0.00 10760.19 1832.58 11085390.13 00:26:12.551 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:26:12.551 Verification LBA range: start 0x0 length 0x8000 00:26:12.551 Nvme_mlx_0_1n1 : 90.01 10512.04 41.06 0.00 0.00 12156.43 2196.67 11085390.13 00:26:12.551 =================================================================================================================== 00:26:12.551 Total : 22390.14 87.46 0.00 0.00 11415.70 1832.58 11085390.13 00:26:12.551 Received shutdown signal, test time was about 90.000000 seconds 00:26:12.551 00:26:12.551 Latency(us) 00:26:12.551 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:12.551 =================================================================================================================== 00:26:12.551 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:12.551 01:00:18 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:26:12.552 01:00:18 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:26:12.552 01:00:18 -- target/device_removal.sh@202 -- # killprocess 407690 00:26:12.552 01:00:18 -- common/autotest_common.sh@936 -- # '[' -z 407690 ']' 00:26:12.552 01:00:18 -- common/autotest_common.sh@940 -- # kill -0 407690 00:26:12.552 01:00:18 -- common/autotest_common.sh@941 -- # uname 00:26:12.552 01:00:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:12.552 01:00:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 407690 00:26:12.552 01:00:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:12.552 01:00:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:12.552 01:00:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 407690' 00:26:12.552 killing process with pid 407690 00:26:12.552 01:00:18 -- common/autotest_common.sh@955 -- # kill 407690 00:26:12.552 01:00:18 -- common/autotest_common.sh@960 -- # wait 407690 00:26:12.552 [2024-04-26 01:00:18.763895] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:12.552 01:00:19 -- target/device_removal.sh@203 -- # nvmfpid= 00:26:12.552 01:00:19 -- target/device_removal.sh@205 -- # return 0 00:26:12.552 00:26:12.552 real 1m33.138s 00:26:12.552 user 4m27.398s 00:26:12.552 sys 0m5.822s 00:26:12.552 01:00:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:12.552 01:00:19 -- common/autotest_common.sh@10 -- # set +x 00:26:12.552 ************************************ 00:26:12.552 END TEST nvmf_device_removal_pci_remove 00:26:12.552 ************************************ 00:26:12.552 01:00:19 -- target/device_removal.sh@317 -- # nvmftestfini 00:26:12.552 01:00:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:12.552 01:00:19 -- nvmf/common.sh@117 -- # sync 00:26:12.552 01:00:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@120 -- # set +e 00:26:12.552 01:00:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:12.552 01:00:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:12.552 rmmod nvme_rdma 00:26:12.552 rmmod nvme_fabrics 00:26:12.552 01:00:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:12.552 01:00:19 -- nvmf/common.sh@124 -- # set -e 00:26:12.552 01:00:19 -- nvmf/common.sh@125 -- # return 0 00:26:12.552 01:00:19 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:12.552 01:00:19 -- target/device_removal.sh@318 -- # clean_bond_device 00:26:12.552 01:00:19 -- target/device_removal.sh@240 -- # ip link 00:26:12.552 01:00:19 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:26:12.552 00:26:12.552 real 3m11.750s 00:26:12.552 user 8m56.260s 00:26:12.552 sys 0m15.335s 00:26:12.552 01:00:19 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:12.552 01:00:19 -- common/autotest_common.sh@10 -- # set +x 00:26:12.552 ************************************ 00:26:12.552 END TEST nvmf_device_removal 00:26:12.552 ************************************ 00:26:12.552 01:00:19 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:26:12.552 01:00:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:12.552 01:00:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:12.552 01:00:19 -- common/autotest_common.sh@10 -- # set +x 00:26:12.552 ************************************ 00:26:12.552 START TEST nvmf_srq_overwhelm 00:26:12.552 ************************************ 00:26:12.552 01:00:19 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:26:12.552 * Looking for test storage... 00:26:12.552 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:26:12.552 01:00:19 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:12.552 01:00:19 -- nvmf/common.sh@7 -- # uname -s 00:26:12.552 01:00:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:12.552 01:00:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:12.552 01:00:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:12.552 01:00:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:12.552 01:00:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:12.552 01:00:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:12.552 01:00:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:12.552 01:00:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:12.552 01:00:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:12.552 01:00:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:12.552 01:00:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:12.552 01:00:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:12.552 01:00:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:12.552 01:00:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:12.552 01:00:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:12.552 01:00:19 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:12.552 01:00:19 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:12.552 01:00:19 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:12.552 01:00:19 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:12.552 01:00:19 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:12.552 01:00:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.552 01:00:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.552 01:00:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.552 01:00:19 -- paths/export.sh@5 -- # export PATH 00:26:12.552 01:00:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:12.552 01:00:19 -- nvmf/common.sh@47 -- # : 0 00:26:12.552 01:00:19 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:12.552 01:00:19 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:12.552 01:00:19 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:12.552 01:00:19 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:12.552 01:00:19 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:12.552 01:00:19 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:12.552 01:00:19 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:12.552 01:00:19 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:26:12.552 01:00:19 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:26:12.552 01:00:19 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:12.552 01:00:19 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:12.552 01:00:19 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:12.552 01:00:19 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:12.552 01:00:19 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:12.552 01:00:19 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:12.552 01:00:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:12.552 01:00:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:12.552 01:00:19 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:12.552 01:00:19 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:12.552 01:00:19 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:12.552 01:00:19 -- common/autotest_common.sh@10 -- # set +x 00:26:17.829 01:00:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:17.829 01:00:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:17.829 01:00:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:17.829 01:00:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:17.829 01:00:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:17.829 01:00:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:17.829 01:00:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:17.829 01:00:24 -- nvmf/common.sh@295 -- # net_devs=() 00:26:17.829 01:00:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:17.829 01:00:24 -- nvmf/common.sh@296 -- # e810=() 00:26:17.829 01:00:24 -- nvmf/common.sh@296 -- # local -ga e810 00:26:17.829 01:00:24 -- nvmf/common.sh@297 -- # x722=() 00:26:17.829 01:00:24 -- nvmf/common.sh@297 -- # local -ga x722 00:26:17.829 01:00:24 -- nvmf/common.sh@298 -- # mlx=() 00:26:17.829 01:00:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:17.829 01:00:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:17.829 01:00:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:17.830 01:00:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:17.830 01:00:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:17.830 01:00:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:17.830 01:00:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:17.830 01:00:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:17.830 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:17.830 01:00:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:17.830 01:00:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:17.830 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:17.830 01:00:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:17.830 01:00:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.830 01:00:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.830 01:00:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:17.830 Found net devices under 0000:18:00.0: mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:17.830 01:00:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:17.830 01:00:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:17.830 Found net devices under 0000:18:00.1: mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:17.830 01:00:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:17.830 01:00:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:17.830 01:00:24 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:17.830 01:00:24 -- nvmf/common.sh@58 -- # uname 00:26:17.830 01:00:24 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:17.830 01:00:24 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:17.830 01:00:24 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:17.830 01:00:24 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:17.830 01:00:24 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:17.830 01:00:24 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:17.830 01:00:24 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:17.830 01:00:24 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:17.830 01:00:24 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:17.830 01:00:24 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:17.830 01:00:24 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:17.830 01:00:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:17.830 01:00:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:17.830 01:00:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:17.830 01:00:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:17.830 01:00:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@105 -- # continue 2 00:26:17.830 01:00:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@105 -- # continue 2 00:26:17.830 01:00:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:17.830 01:00:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:17.830 01:00:24 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:17.830 01:00:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:17.830 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:17.830 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:17.830 altname enp24s0f0np0 00:26:17.830 altname ens785f0np0 00:26:17.830 inet 192.168.100.8/24 scope global mlx_0_0 00:26:17.830 valid_lft forever preferred_lft forever 00:26:17.830 01:00:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:17.830 01:00:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:17.830 01:00:24 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:17.830 01:00:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:17.830 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:17.830 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:17.830 altname enp24s0f1np1 00:26:17.830 altname ens785f1np1 00:26:17.830 inet 192.168.100.9/24 scope global mlx_0_1 00:26:17.830 valid_lft forever preferred_lft forever 00:26:17.830 01:00:24 -- nvmf/common.sh@411 -- # return 0 00:26:17.830 01:00:24 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:17.830 01:00:24 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:17.830 01:00:24 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:17.830 01:00:24 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:17.830 01:00:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:17.830 01:00:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:17.830 01:00:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:17.830 01:00:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:17.830 01:00:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:17.830 01:00:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@105 -- # continue 2 00:26:17.830 01:00:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:17.830 01:00:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:17.830 01:00:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@105 -- # continue 2 00:26:17.830 01:00:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:17.830 01:00:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:17.830 01:00:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:17.830 01:00:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:17.830 01:00:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:17.830 01:00:24 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:17.830 192.168.100.9' 00:26:17.830 01:00:24 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:17.830 192.168.100.9' 00:26:17.830 01:00:24 -- nvmf/common.sh@446 -- # head -n 1 00:26:17.830 01:00:24 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:17.830 01:00:24 -- nvmf/common.sh@447 -- # head -n 1 00:26:17.830 01:00:24 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:17.830 192.168.100.9' 00:26:17.830 01:00:24 -- nvmf/common.sh@447 -- # tail -n +2 00:26:17.830 01:00:24 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:17.830 01:00:24 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:17.830 01:00:24 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:17.830 01:00:24 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:17.831 01:00:24 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:17.831 01:00:24 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:17.831 01:00:24 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:26:17.831 01:00:24 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:17.831 01:00:24 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:17.831 01:00:24 -- common/autotest_common.sh@10 -- # set +x 00:26:17.831 01:00:24 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:17.831 01:00:24 -- nvmf/common.sh@470 -- # nvmfpid=428098 00:26:17.831 01:00:24 -- nvmf/common.sh@471 -- # waitforlisten 428098 00:26:17.831 01:00:24 -- common/autotest_common.sh@817 -- # '[' -z 428098 ']' 00:26:17.831 01:00:24 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:17.831 01:00:24 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:17.831 01:00:24 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:17.831 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:17.831 01:00:24 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:17.831 01:00:24 -- common/autotest_common.sh@10 -- # set +x 00:26:17.831 [2024-04-26 01:00:24.733762] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:17.831 [2024-04-26 01:00:24.733804] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:17.831 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.831 [2024-04-26 01:00:24.785319] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:17.831 [2024-04-26 01:00:24.858495] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:17.831 [2024-04-26 01:00:24.858530] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:17.831 [2024-04-26 01:00:24.858536] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:17.831 [2024-04-26 01:00:24.858542] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:17.831 [2024-04-26 01:00:24.858546] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:17.831 [2024-04-26 01:00:24.858582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:17.831 [2024-04-26 01:00:24.858679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:17.831 [2024-04-26 01:00:24.858750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:17.831 [2024-04-26 01:00:24.858751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:18.396 01:00:25 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:18.396 01:00:25 -- common/autotest_common.sh@850 -- # return 0 00:26:18.396 01:00:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:18.396 01:00:25 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:18.396 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.396 01:00:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:18.396 01:00:25 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:26:18.396 01:00:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:18.396 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.655 [2024-04-26 01:00:25.603433] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x998880/0x99cd70) succeed. 00:26:18.655 [2024-04-26 01:00:25.612906] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x999ec0/0x9de400) succeed. 00:26:18.655 01:00:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:26:18.655 01:00:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:18.655 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.655 01:00:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:18.655 01:00:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:18.655 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.655 Malloc0 00:26:18.655 01:00:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:26:18.655 01:00:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:18.655 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.655 01:00:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:26:18.655 01:00:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:18.655 01:00:25 -- common/autotest_common.sh@10 -- # set +x 00:26:18.655 [2024-04-26 01:00:25.705672] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:18.655 01:00:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:18.655 01:00:25 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:26:19.588 01:00:26 -- common/autotest_common.sh@1221 -- # local i=0 00:26:19.588 01:00:26 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:19.588 01:00:26 -- common/autotest_common.sh@1222 -- # grep -q -w nvme0n1 00:26:19.588 01:00:26 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:19.588 01:00:26 -- common/autotest_common.sh@1228 -- # grep -q -w nvme0n1 00:26:19.588 01:00:26 -- common/autotest_common.sh@1232 -- # return 0 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:19.588 01:00:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:19.588 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:26:19.588 01:00:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:26:19.588 01:00:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:19.588 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:26:19.588 Malloc1 00:26:19.588 01:00:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:19.588 01:00:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:19.588 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:26:19.588 01:00:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:26:19.588 01:00:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:19.588 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:26:19.588 01:00:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:19.588 01:00:26 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:26:20.963 01:00:27 -- common/autotest_common.sh@1221 -- # local i=0 00:26:20.963 01:00:27 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:20.963 01:00:27 -- common/autotest_common.sh@1222 -- # grep -q -w nvme1n1 00:26:20.963 01:00:27 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:20.963 01:00:27 -- common/autotest_common.sh@1228 -- # grep -q -w nvme1n1 00:26:20.963 01:00:27 -- common/autotest_common.sh@1232 -- # return 0 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:26:20.963 01:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.963 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:26:20.963 01:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:26:20.963 01:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.963 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:26:20.963 Malloc2 00:26:20.963 01:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:26:20.963 01:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.963 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:26:20.963 01:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:26:20.963 01:00:27 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:20.963 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:26:20.963 01:00:27 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:20.963 01:00:27 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:26:21.898 01:00:28 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:26:21.898 01:00:28 -- common/autotest_common.sh@1221 -- # local i=0 00:26:21.898 01:00:28 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:21.898 01:00:28 -- common/autotest_common.sh@1222 -- # grep -q -w nvme2n1 00:26:21.898 01:00:28 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:21.898 01:00:28 -- common/autotest_common.sh@1228 -- # grep -q -w nvme2n1 00:26:21.898 01:00:28 -- common/autotest_common.sh@1232 -- # return 0 00:26:21.898 01:00:28 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:21.898 01:00:28 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:26:21.898 01:00:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.898 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:26:21.898 01:00:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.898 01:00:28 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:26:21.898 01:00:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.898 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:26:21.898 Malloc3 00:26:21.898 01:00:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.899 01:00:28 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:26:21.899 01:00:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.899 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:26:21.899 01:00:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.899 01:00:28 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:26:21.899 01:00:28 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:21.899 01:00:28 -- common/autotest_common.sh@10 -- # set +x 00:26:21.899 01:00:28 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:21.899 01:00:28 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:26:22.833 01:00:29 -- common/autotest_common.sh@1221 -- # local i=0 00:26:22.833 01:00:29 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:22.833 01:00:29 -- common/autotest_common.sh@1222 -- # grep -q -w nvme3n1 00:26:22.833 01:00:29 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:22.833 01:00:29 -- common/autotest_common.sh@1228 -- # grep -q -w nvme3n1 00:26:22.833 01:00:29 -- common/autotest_common.sh@1232 -- # return 0 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:26:22.833 01:00:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.833 01:00:29 -- common/autotest_common.sh@10 -- # set +x 00:26:22.833 01:00:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:26:22.833 01:00:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.833 01:00:29 -- common/autotest_common.sh@10 -- # set +x 00:26:22.833 Malloc4 00:26:22.833 01:00:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:26:22.833 01:00:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.833 01:00:29 -- common/autotest_common.sh@10 -- # set +x 00:26:22.833 01:00:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:26:22.833 01:00:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:22.833 01:00:29 -- common/autotest_common.sh@10 -- # set +x 00:26:22.833 01:00:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:22.833 01:00:29 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:26:23.770 01:00:30 -- common/autotest_common.sh@1221 -- # local i=0 00:26:23.770 01:00:30 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:23.770 01:00:30 -- common/autotest_common.sh@1222 -- # grep -q -w nvme4n1 00:26:23.770 01:00:30 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:23.770 01:00:30 -- common/autotest_common.sh@1228 -- # grep -q -w nvme4n1 00:26:23.770 01:00:30 -- common/autotest_common.sh@1232 -- # return 0 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:26:23.770 01:00:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.770 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:26:23.770 01:00:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:26:23.770 01:00:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.770 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:26:23.770 Malloc5 00:26:23.770 01:00:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:26:23.770 01:00:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.770 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:26:23.770 01:00:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:26:23.770 01:00:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:23.770 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:26:23.770 01:00:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:23.770 01:00:30 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:26:24.707 01:00:31 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:26:24.707 01:00:31 -- common/autotest_common.sh@1221 -- # local i=0 00:26:24.707 01:00:31 -- common/autotest_common.sh@1222 -- # lsblk -l -o NAME 00:26:24.707 01:00:31 -- common/autotest_common.sh@1222 -- # grep -q -w nvme5n1 00:26:24.707 01:00:31 -- common/autotest_common.sh@1228 -- # lsblk -l -o NAME 00:26:24.707 01:00:31 -- common/autotest_common.sh@1228 -- # grep -q -w nvme5n1 00:26:24.707 01:00:31 -- common/autotest_common.sh@1232 -- # return 0 00:26:24.707 01:00:31 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:26:24.707 [global] 00:26:24.707 thread=1 00:26:24.707 invalidate=1 00:26:24.707 rw=read 00:26:24.707 time_based=1 00:26:24.707 runtime=10 00:26:24.707 ioengine=libaio 00:26:24.707 direct=1 00:26:24.707 bs=1048576 00:26:24.707 iodepth=128 00:26:24.707 norandommap=1 00:26:24.707 numjobs=13 00:26:24.707 00:26:24.707 [job0] 00:26:24.707 filename=/dev/nvme0n1 00:26:24.707 [job1] 00:26:24.707 filename=/dev/nvme1n1 00:26:24.707 [job2] 00:26:24.707 filename=/dev/nvme2n1 00:26:24.966 [job3] 00:26:24.966 filename=/dev/nvme3n1 00:26:24.966 [job4] 00:26:24.966 filename=/dev/nvme4n1 00:26:24.966 [job5] 00:26:24.966 filename=/dev/nvme5n1 00:26:24.966 Could not set queue depth (nvme0n1) 00:26:24.966 Could not set queue depth (nvme1n1) 00:26:24.966 Could not set queue depth (nvme2n1) 00:26:24.966 Could not set queue depth (nvme3n1) 00:26:24.966 Could not set queue depth (nvme4n1) 00:26:24.966 Could not set queue depth (nvme5n1) 00:26:25.225 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:26:25.225 ... 00:26:25.225 fio-3.35 00:26:25.225 Starting 78 threads 00:26:40.117 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429650: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=28, BW=28.8MiB/s (30.2MB/s)(306MiB/10623msec) 00:26:40.117 slat (usec): min=403, max=2099.5k, avg=32840.47, stdev=230051.20 00:26:40.117 clat (msec): min=572, max=8944, avg=2095.22, stdev=2587.61 00:26:40.117 lat (msec): min=628, max=8945, avg=2128.06, stdev=2615.74 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 634], 5.00th=[ 651], 10.00th=[ 735], 20.00th=[ 810], 00:26:40.117 | 30.00th=[ 835], 40.00th=[ 869], 50.00th=[ 894], 60.00th=[ 1003], 00:26:40.117 | 70.00th=[ 1200], 80.00th=[ 2198], 90.00th=[ 7080], 95.00th=[ 8926], 00:26:40.117 | 99.00th=[ 8926], 99.50th=[ 8926], 99.90th=[ 8926], 99.95th=[ 8926], 00:26:40.117 | 99.99th=[ 8926] 00:26:40.117 bw ( KiB/s): min= 2048, max=177385, per=2.64%, avg=90938.25, stdev=85545.64, samples=4 00:26:40.117 iops : min= 2, max= 173, avg=88.75, stdev=83.46, samples=4 00:26:40.117 lat (msec) : 750=10.13%, 1000=50.00%, 2000=18.95%, >=2000=20.92% 00:26:40.117 cpu : usr=0.00%, sys=0.86%, ctx=281, majf=0, minf=32769 00:26:40.117 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.6%, 16=5.2%, 32=10.5%, >=64=79.4% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:26:40.117 issued rwts: total=306,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429651: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=105, BW=106MiB/s (111MB/s)(1348MiB/12748msec) 00:26:40.117 slat (usec): min=43, max=2093.4k, avg=7903.18, stdev=98228.07 00:26:40.117 clat (msec): min=235, max=8955, avg=1177.12, stdev=2430.72 00:26:40.117 lat (msec): min=236, max=8957, avg=1185.02, stdev=2439.04 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 241], 00:26:40.117 | 30.00th=[ 243], 40.00th=[ 247], 50.00th=[ 249], 60.00th=[ 257], 00:26:40.117 | 70.00th=[ 542], 80.00th=[ 735], 90.00th=[ 2601], 95.00th=[ 8792], 00:26:40.117 | 99.00th=[ 8926], 99.50th=[ 8926], 99.90th=[ 8926], 99.95th=[ 8926], 00:26:40.117 | 99.99th=[ 8926] 00:26:40.117 bw ( KiB/s): min= 1954, max=539592, per=6.05%, avg=208286.17, stdev=226998.70, samples=12 00:26:40.117 iops : min= 1, max= 526, avg=203.25, stdev=221.63, samples=12 00:26:40.117 lat (msec) : 250=54.30%, 500=12.61%, 750=13.58%, 1000=6.31%, 2000=3.04% 00:26:40.117 lat (msec) : >=2000=10.16% 00:26:40.117 cpu : usr=0.02%, sys=1.03%, ctx=1521, majf=0, minf=32015 00:26:40.117 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.4%, >=64=95.3% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.117 issued rwts: total=1348,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429652: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=15, BW=15.2MiB/s (15.9MB/s)(162MiB/10653msec) 00:26:40.117 slat (usec): min=1027, max=2174.2k, avg=65408.30, stdev=315389.84 00:26:40.117 clat (msec): min=55, max=10096, avg=7625.91, stdev=2921.24 00:26:40.117 lat (msec): min=1805, max=10107, avg=7691.32, stdev=2863.42 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 1804], 5.00th=[ 1854], 10.00th=[ 1921], 20.00th=[ 4329], 00:26:40.117 | 30.00th=[ 8221], 40.00th=[ 8792], 50.00th=[ 8926], 60.00th=[ 9194], 00:26:40.117 | 70.00th=[ 9463], 80.00th=[ 9597], 90.00th=[ 9866], 95.00th=[10000], 00:26:40.117 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:26:40.117 | 99.99th=[10134] 00:26:40.117 bw ( KiB/s): min= 6144, max=26624, per=0.40%, avg=13926.40, stdev=9089.98, samples=5 00:26:40.117 iops : min= 6, max= 26, avg=13.60, stdev= 8.88, samples=5 00:26:40.117 lat (msec) : 100=0.62%, 2000=11.11%, >=2000=88.27% 00:26:40.117 cpu : usr=0.00%, sys=0.76%, ctx=493, majf=0, minf=32769 00:26:40.117 IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=4.9%, 16=9.9%, 32=19.8%, >=64=61.1% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=97.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.8% 00:26:40.117 issued rwts: total=162,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429653: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=26, BW=26.5MiB/s (27.8MB/s)(283MiB/10677msec) 00:26:40.117 slat (usec): min=577, max=2175.3k, avg=35388.06, stdev=214262.52 00:26:40.117 clat (msec): min=660, max=8423, avg=4437.09, stdev=3313.31 00:26:40.117 lat (msec): min=676, max=8437, avg=4472.48, stdev=3319.24 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 684], 5.00th=[ 802], 10.00th=[ 953], 20.00th=[ 1234], 00:26:40.117 | 30.00th=[ 1435], 40.00th=[ 1787], 50.00th=[ 2165], 60.00th=[ 7886], 00:26:40.117 | 70.00th=[ 8020], 80.00th=[ 8154], 90.00th=[ 8356], 95.00th=[ 8356], 00:26:40.117 | 99.00th=[ 8423], 99.50th=[ 8423], 99.90th=[ 8423], 99.95th=[ 8423], 00:26:40.117 | 99.99th=[ 8423] 00:26:40.117 bw ( KiB/s): min= 6144, max=103413, per=1.16%, avg=39803.50, stdev=40701.08, samples=8 00:26:40.117 iops : min= 6, max= 100, avg=38.62, stdev=39.62, samples=8 00:26:40.117 lat (msec) : 750=3.18%, 1000=8.83%, 2000=36.75%, >=2000=51.24% 00:26:40.117 cpu : usr=0.00%, sys=0.82%, ctx=711, majf=0, minf=32769 00:26:40.117 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.8%, 16=5.7%, 32=11.3%, >=64=77.7% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:26:40.117 issued rwts: total=283,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429654: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=14, BW=14.4MiB/s (15.1MB/s)(182MiB/12642msec) 00:26:40.117 slat (usec): min=397, max=2168.8k, avg=57954.14, stdev=308090.96 00:26:40.117 clat (msec): min=1108, max=11719, avg=8191.32, stdev=4284.42 00:26:40.117 lat (msec): min=1136, max=11726, avg=8249.27, stdev=4260.61 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 1133], 5.00th=[ 1150], 10.00th=[ 1200], 20.00th=[ 1301], 00:26:40.117 | 30.00th=[ 5403], 40.00th=[10671], 50.00th=[11073], 60.00th=[11208], 00:26:40.117 | 70.00th=[11342], 80.00th=[11476], 90.00th=[11610], 95.00th=[11610], 00:26:40.117 | 99.00th=[11745], 99.50th=[11745], 99.90th=[11745], 99.95th=[11745], 00:26:40.117 | 99.99th=[11745] 00:26:40.117 bw ( KiB/s): min= 2052, max=67584, per=0.55%, avg=18774.00, stdev=24315.23, samples=6 00:26:40.117 iops : min= 2, max= 66, avg=18.33, stdev=23.75, samples=6 00:26:40.117 lat (msec) : 2000=21.98%, >=2000=78.02% 00:26:40.117 cpu : usr=0.02%, sys=0.62%, ctx=478, majf=0, minf=32769 00:26:40.117 IO depths : 1=0.5%, 2=1.1%, 4=2.2%, 8=4.4%, 16=8.8%, 32=17.6%, >=64=65.4% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=98.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.8% 00:26:40.117 issued rwts: total=182,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429655: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=25, BW=25.8MiB/s (27.0MB/s)(274MiB/10638msec) 00:26:40.117 slat (usec): min=117, max=2157.7k, avg=36508.34, stdev=216769.65 00:26:40.117 clat (msec): min=633, max=8849, avg=4637.55, stdev=3381.63 00:26:40.117 lat (msec): min=638, max=8862, avg=4674.05, stdev=3386.25 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 642], 5.00th=[ 760], 10.00th=[ 953], 20.00th=[ 1452], 00:26:40.117 | 30.00th=[ 1586], 40.00th=[ 1653], 50.00th=[ 2165], 60.00th=[ 8087], 00:26:40.117 | 70.00th=[ 8288], 80.00th=[ 8288], 90.00th=[ 8356], 95.00th=[ 8658], 00:26:40.117 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:26:40.117 | 99.99th=[ 8792] 00:26:40.117 bw ( KiB/s): min= 4096, max=79872, per=0.97%, avg=33353.44, stdev=32408.89, samples=9 00:26:40.117 iops : min= 4, max= 78, avg=32.56, stdev=31.63, samples=9 00:26:40.117 lat (msec) : 750=4.74%, 1000=5.84%, 2000=36.50%, >=2000=52.92% 00:26:40.117 cpu : usr=0.00%, sys=0.82%, ctx=775, majf=0, minf=32769 00:26:40.117 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.8%, 32=11.7%, >=64=77.0% 00:26:40.117 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.117 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:26:40.117 issued rwts: total=274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.117 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.117 job0: (groupid=0, jobs=1): err= 0: pid=429656: Fri Apr 26 01:00:45 2024 00:26:40.117 read: IOPS=38, BW=38.7MiB/s (40.5MB/s)(409MiB/10581msec) 00:26:40.117 slat (usec): min=49, max=2064.3k, avg=25761.94, stdev=191988.53 00:26:40.117 clat (msec): min=42, max=8653, avg=3158.66, stdev=2957.15 00:26:40.117 lat (msec): min=371, max=8661, avg=3184.42, stdev=2960.68 00:26:40.117 clat percentiles (msec): 00:26:40.117 | 1.00th=[ 372], 5.00th=[ 451], 10.00th=[ 584], 20.00th=[ 894], 00:26:40.117 | 30.00th=[ 1062], 40.00th=[ 1234], 50.00th=[ 1385], 60.00th=[ 2056], 00:26:40.117 | 70.00th=[ 4212], 80.00th=[ 8154], 90.00th=[ 8221], 95.00th=[ 8288], 00:26:40.118 | 99.00th=[ 8288], 99.50th=[ 8658], 99.90th=[ 8658], 99.95th=[ 8658], 00:26:40.118 | 99.99th=[ 8658] 00:26:40.118 bw ( KiB/s): min= 8192, max=280576, per=2.39%, avg=82177.43, stdev=96864.48, samples=7 00:26:40.118 iops : min= 8, max= 274, avg=80.14, stdev=94.54, samples=7 00:26:40.118 lat (msec) : 50=0.24%, 500=7.09%, 750=8.31%, 1000=10.02%, 2000=33.50% 00:26:40.118 lat (msec) : >=2000=40.83% 00:26:40.118 cpu : usr=0.00%, sys=0.86%, ctx=599, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=3.9%, 32=7.8%, >=64=84.6% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:40.118 issued rwts: total=409,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429657: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=35, BW=35.2MiB/s (36.9MB/s)(448MiB/12743msec) 00:26:40.118 slat (usec): min=42, max=2158.8k, avg=23767.86, stdev=182902.47 00:26:40.118 clat (msec): min=472, max=8564, avg=3449.97, stdev=2906.48 00:26:40.118 lat (msec): min=473, max=10723, avg=3473.74, stdev=2922.02 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 472], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 911], 00:26:40.118 | 30.00th=[ 1167], 40.00th=[ 1368], 50.00th=[ 2735], 60.00th=[ 2802], 00:26:40.118 | 70.00th=[ 3004], 80.00th=[ 7886], 90.00th=[ 8087], 95.00th=[ 8154], 00:26:40.118 | 99.00th=[ 8490], 99.50th=[ 8557], 99.90th=[ 8557], 99.95th=[ 8557], 00:26:40.118 | 99.99th=[ 8557] 00:26:40.118 bw ( KiB/s): min= 1954, max=215040, per=2.12%, avg=73034.89, stdev=88985.49, samples=9 00:26:40.118 iops : min= 1, max= 210, avg=71.22, stdev=86.99, samples=9 00:26:40.118 lat (msec) : 500=12.28%, 750=0.67%, 1000=9.38%, 2000=19.42%, >=2000=58.26% 00:26:40.118 cpu : usr=0.00%, sys=0.86%, ctx=669, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.1%, >=64=85.9% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.118 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429658: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=12, BW=12.7MiB/s (13.3MB/s)(161MiB/12676msec) 00:26:40.118 slat (usec): min=600, max=2168.8k, avg=65694.63, stdev=325498.89 00:26:40.118 clat (msec): min=1661, max=12182, avg=9333.80, stdev=3576.42 00:26:40.118 lat (msec): min=1678, max=12198, avg=9399.50, stdev=3532.27 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1703], 20.00th=[ 5940], 00:26:40.118 | 30.00th=[ 8557], 40.00th=[10939], 50.00th=[11208], 60.00th=[11342], 00:26:40.118 | 70.00th=[11610], 80.00th=[11879], 90.00th=[12013], 95.00th=[12147], 00:26:40.118 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:26:40.118 | 99.99th=[12147] 00:26:40.118 bw ( KiB/s): min= 1446, max=36864, per=0.33%, avg=11505.00, stdev=12761.81, samples=6 00:26:40.118 iops : min= 1, max= 36, avg=11.17, stdev=12.53, samples=6 00:26:40.118 lat (msec) : 2000=11.18%, >=2000=88.82% 00:26:40.118 cpu : usr=0.00%, sys=0.60%, ctx=456, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=5.0%, 16=9.9%, 32=19.9%, >=64=60.9% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=97.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.9% 00:26:40.118 issued rwts: total=161,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429659: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=15, BW=15.2MiB/s (16.0MB/s)(193MiB/12661msec) 00:26:40.118 slat (usec): min=720, max=2130.2k, avg=54753.60, stdev=298061.91 00:26:40.118 clat (msec): min=1129, max=11613, avg=7729.96, stdev=4393.55 00:26:40.118 lat (msec): min=1135, max=11626, avg=7784.71, stdev=4376.37 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 1133], 5.00th=[ 1167], 10.00th=[ 1234], 20.00th=[ 1385], 00:26:40.118 | 30.00th=[ 3272], 40.00th=[ 8557], 50.00th=[10805], 60.00th=[10939], 00:26:40.118 | 70.00th=[11208], 80.00th=[11342], 90.00th=[11476], 95.00th=[11476], 00:26:40.118 | 99.00th=[11610], 99.50th=[11610], 99.90th=[11610], 99.95th=[11610], 00:26:40.118 | 99.99th=[11610] 00:26:40.118 bw ( KiB/s): min= 1456, max=106496, per=0.78%, avg=26915.20, stdev=44610.69, samples=5 00:26:40.118 iops : min= 1, max= 104, avg=26.20, stdev=43.63, samples=5 00:26:40.118 lat (msec) : 2000=26.94%, >=2000=73.06% 00:26:40.118 cpu : usr=0.01%, sys=0.72%, ctx=475, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.1%, 16=8.3%, 32=16.6%, >=64=67.4% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:26:40.118 issued rwts: total=193,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429660: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=15, BW=15.2MiB/s (15.9MB/s)(193MiB/12710msec) 00:26:40.118 slat (usec): min=664, max=2166.0k, avg=55007.24, stdev=302476.01 00:26:40.118 clat (msec): min=1026, max=11675, avg=7773.18, stdev=4557.18 00:26:40.118 lat (msec): min=1035, max=11681, avg=7828.18, stdev=4539.82 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 1028], 5.00th=[ 1062], 10.00th=[ 1183], 20.00th=[ 1385], 00:26:40.118 | 30.00th=[ 1519], 40.00th=[10671], 50.00th=[10805], 60.00th=[11073], 00:26:40.118 | 70.00th=[11208], 80.00th=[11342], 90.00th=[11610], 95.00th=[11610], 00:26:40.118 | 99.00th=[11610], 99.50th=[11610], 99.90th=[11610], 99.95th=[11610], 00:26:40.118 | 99.99th=[11610] 00:26:40.118 bw ( KiB/s): min= 2048, max=118784, per=0.65%, avg=22528.00, stdev=47184.07, samples=6 00:26:40.118 iops : min= 2, max= 116, avg=22.00, stdev=46.08, samples=6 00:26:40.118 lat (msec) : 2000=30.05%, >=2000=69.95% 00:26:40.118 cpu : usr=0.00%, sys=0.54%, ctx=536, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.1%, 16=8.3%, 32=16.6%, >=64=67.4% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:26:40.118 issued rwts: total=193,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429661: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=28, BW=28.6MiB/s (29.9MB/s)(364MiB/12745msec) 00:26:40.118 slat (usec): min=87, max=2130.2k, avg=29266.31, stdev=219027.63 00:26:40.118 clat (msec): min=591, max=11550, avg=4341.37, stdev=4822.39 00:26:40.118 lat (msec): min=596, max=11554, avg=4370.63, stdev=4833.49 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 600], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 642], 00:26:40.118 | 30.00th=[ 684], 40.00th=[ 726], 50.00th=[ 810], 60.00th=[ 936], 00:26:40.118 | 70.00th=[10805], 80.00th=[11073], 90.00th=[11342], 95.00th=[11476], 00:26:40.118 | 99.00th=[11476], 99.50th=[11476], 99.90th=[11610], 99.95th=[11610], 00:26:40.118 | 99.99th=[11610] 00:26:40.118 bw ( KiB/s): min= 1954, max=159744, per=1.57%, avg=53920.22, stdev=72553.59, samples=9 00:26:40.118 iops : min= 1, max= 156, avg=52.56, stdev=70.94, samples=9 00:26:40.118 lat (msec) : 750=43.41%, 1000=18.41%, >=2000=38.19% 00:26:40.118 cpu : usr=0.00%, sys=0.95%, ctx=492, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.2%, 16=4.4%, 32=8.8%, >=64=82.7% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:40.118 issued rwts: total=364,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job0: (groupid=0, jobs=1): err= 0: pid=429663: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=23, BW=23.5MiB/s (24.7MB/s)(250MiB/10629msec) 00:26:40.118 slat (usec): min=85, max=2079.9k, avg=42287.52, stdev=255129.88 00:26:40.118 clat (msec): min=55, max=9199, avg=4956.18, stdev=3447.21 00:26:40.118 lat (msec): min=990, max=9203, avg=4998.47, stdev=3438.18 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 986], 5.00th=[ 1020], 10.00th=[ 1062], 20.00th=[ 1099], 00:26:40.118 | 30.00th=[ 1234], 40.00th=[ 2836], 50.00th=[ 4933], 60.00th=[ 7013], 00:26:40.118 | 70.00th=[ 8557], 80.00th=[ 8792], 90.00th=[ 9060], 95.00th=[ 9060], 00:26:40.118 | 99.00th=[ 9194], 99.50th=[ 9194], 99.90th=[ 9194], 99.95th=[ 9194], 00:26:40.118 | 99.99th=[ 9194] 00:26:40.118 bw ( KiB/s): min=12288, max=122634, per=1.21%, avg=41601.67, stdev=42009.63, samples=6 00:26:40.118 iops : min= 12, max= 119, avg=40.50, stdev=40.73, samples=6 00:26:40.118 lat (msec) : 100=0.40%, 1000=2.40%, 2000=32.80%, >=2000=64.40% 00:26:40.118 cpu : usr=0.02%, sys=0.66%, ctx=572, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.2%, 16=6.4%, 32=12.8%, >=64=74.8% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:26:40.118 issued rwts: total=250,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.118 job1: (groupid=0, jobs=1): err= 0: pid=429672: Fri Apr 26 01:00:45 2024 00:26:40.118 read: IOPS=237, BW=237MiB/s (249MB/s)(2507MiB/10568msec) 00:26:40.118 slat (usec): min=33, max=2048.3k, avg=4206.57, stdev=41680.41 00:26:40.118 clat (msec): min=15, max=2294, avg=507.91, stdev=554.79 00:26:40.118 lat (msec): min=117, max=2295, avg=512.12, stdev=557.30 00:26:40.118 clat percentiles (msec): 00:26:40.118 | 1.00th=[ 118], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 121], 00:26:40.118 | 30.00th=[ 122], 40.00th=[ 241], 50.00th=[ 245], 60.00th=[ 266], 00:26:40.118 | 70.00th=[ 472], 80.00th=[ 969], 90.00th=[ 1284], 95.00th=[ 2072], 00:26:40.118 | 99.00th=[ 2265], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], 00:26:40.118 | 99.99th=[ 2299] 00:26:40.118 bw ( KiB/s): min=71680, max=1083392, per=9.43%, avg=324793.93, stdev=305528.96, samples=15 00:26:40.118 iops : min= 70, max= 1058, avg=317.13, stdev=298.40, samples=15 00:26:40.118 lat (msec) : 20=0.04%, 250=57.24%, 500=13.60%, 750=4.47%, 1000=4.91% 00:26:40.118 lat (msec) : 2000=14.68%, >=2000=5.07% 00:26:40.118 cpu : usr=0.09%, sys=1.57%, ctx=3293, majf=0, minf=32769 00:26:40.118 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.3%, 16=0.6%, 32=1.3%, >=64=97.5% 00:26:40.118 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.118 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.118 issued rwts: total=2507,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.118 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429673: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=67, BW=67.7MiB/s (70.9MB/s)(715MiB/10569msec) 00:26:40.119 slat (usec): min=380, max=2075.2k, avg=14756.80, stdev=123309.46 00:26:40.119 clat (msec): min=15, max=5586, avg=1823.19, stdev=1743.19 00:26:40.119 lat (msec): min=236, max=5590, avg=1837.95, stdev=1748.28 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 236], 5.00th=[ 239], 10.00th=[ 243], 20.00th=[ 485], 00:26:40.119 | 30.00th=[ 651], 40.00th=[ 768], 50.00th=[ 1062], 60.00th=[ 1368], 00:26:40.119 | 70.00th=[ 2198], 80.00th=[ 2970], 90.00th=[ 5336], 95.00th=[ 5470], 00:26:40.119 | 99.00th=[ 5537], 99.50th=[ 5537], 99.90th=[ 5604], 99.95th=[ 5604], 00:26:40.119 | 99.99th=[ 5604] 00:26:40.119 bw ( KiB/s): min=12288, max=456704, per=3.17%, avg=109272.36, stdev=120766.37, samples=11 00:26:40.119 iops : min= 12, max= 446, avg=106.64, stdev=117.95, samples=11 00:26:40.119 lat (msec) : 20=0.14%, 250=10.35%, 500=10.63%, 750=17.06%, 1000=10.35% 00:26:40.119 lat (msec) : 2000=19.02%, >=2000=32.45% 00:26:40.119 cpu : usr=0.01%, sys=1.08%, ctx=1359, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.2%, 32=4.5%, >=64=91.2% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.119 issued rwts: total=715,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429674: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=74, BW=74.5MiB/s (78.2MB/s)(749MiB/10048msec) 00:26:40.119 slat (usec): min=39, max=2040.0k, avg=13357.67, stdev=124611.91 00:26:40.119 clat (msec): min=40, max=6731, avg=1018.14, stdev=1431.60 00:26:40.119 lat (msec): min=59, max=6740, avg=1031.50, stdev=1446.62 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 69], 5.00th=[ 159], 10.00th=[ 257], 20.00th=[ 393], 00:26:40.119 | 30.00th=[ 451], 40.00th=[ 523], 50.00th=[ 584], 60.00th=[ 667], 00:26:40.119 | 70.00th=[ 885], 80.00th=[ 1070], 90.00th=[ 1250], 95.00th=[ 4866], 00:26:40.119 | 99.00th=[ 6745], 99.50th=[ 6745], 99.90th=[ 6745], 99.95th=[ 6745], 00:26:40.119 | 99.99th=[ 6745] 00:26:40.119 bw ( KiB/s): min=96256, max=321716, per=5.22%, avg=179957.14, stdev=81949.94, samples=7 00:26:40.119 iops : min= 94, max= 314, avg=175.71, stdev=79.98, samples=7 00:26:40.119 lat (msec) : 50=0.13%, 100=2.00%, 250=7.08%, 500=28.44%, 750=26.17% 00:26:40.119 lat (msec) : 1000=13.62%, 2000=14.69%, >=2000=7.88% 00:26:40.119 cpu : usr=0.03%, sys=1.18%, ctx=850, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.3%, >=64=91.6% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.119 issued rwts: total=749,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429675: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=59, BW=59.5MiB/s (62.4MB/s)(754MiB/12675msec) 00:26:40.119 slat (usec): min=36, max=2161.1k, avg=14018.78, stdev=127869.78 00:26:40.119 clat (msec): min=360, max=5937, avg=2054.13, stdev=1962.15 00:26:40.119 lat (msec): min=362, max=5939, avg=2068.15, stdev=1969.50 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 363], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 422], 00:26:40.119 | 30.00th=[ 477], 40.00th=[ 600], 50.00th=[ 1183], 60.00th=[ 1385], 00:26:40.119 | 70.00th=[ 3842], 80.00th=[ 3910], 90.00th=[ 5537], 95.00th=[ 5738], 00:26:40.119 | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5940], 99.95th=[ 5940], 00:26:40.119 | 99.99th=[ 5940] 00:26:40.119 bw ( KiB/s): min= 1412, max=339968, per=3.11%, avg=106954.58, stdev=117217.48, samples=12 00:26:40.119 iops : min= 1, max= 332, avg=104.33, stdev=114.58, samples=12 00:26:40.119 lat (msec) : 500=37.53%, 750=9.15%, 1000=0.40%, 2000=18.83%, >=2000=34.08% 00:26:40.119 cpu : usr=0.00%, sys=0.80%, ctx=861, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.6% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.119 issued rwts: total=754,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429676: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=3, BW=3700KiB/s (3788kB/s)(46.0MiB/12732msec) 00:26:40.119 slat (usec): min=356, max=2138.9k, avg=231014.09, stdev=637091.60 00:26:40.119 clat (msec): min=2104, max=12729, avg=11391.43, stdev=2770.71 00:26:40.119 lat (msec): min=4211, max=12731, avg=11622.45, stdev=2396.97 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 2106], 5.00th=[ 4245], 10.00th=[ 6409], 20.00th=[12416], 00:26:40.119 | 30.00th=[12416], 40.00th=[12550], 50.00th=[12550], 60.00th=[12684], 00:26:40.119 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:26:40.119 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:26:40.119 | 99.99th=[12684] 00:26:40.119 lat (msec) : >=2000=100.00% 00:26:40.119 cpu : usr=0.00%, sys=0.31%, ctx=111, majf=0, minf=11777 00:26:40.119 IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=34.8%, 32=32.6%, >=64=0.0% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.119 issued rwts: total=46,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429677: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=11, BW=11.5MiB/s (12.1MB/s)(146MiB/12646msec) 00:26:40.119 slat (usec): min=374, max=2102.3k, avg=72266.55, stdev=349722.50 00:26:40.119 clat (msec): min=2094, max=10669, avg=6565.82, stdev=1398.65 00:26:40.119 lat (msec): min=4181, max=10680, avg=6638.09, stdev=1416.77 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 4178], 5.00th=[ 5671], 10.00th=[ 5738], 20.00th=[ 5805], 00:26:40.119 | 30.00th=[ 5940], 40.00th=[ 6007], 50.00th=[ 6141], 60.00th=[ 6208], 00:26:40.119 | 70.00th=[ 6342], 80.00th=[ 6946], 90.00th=[ 8490], 95.00th=[10671], 00:26:40.119 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:26:40.119 | 99.99th=[10671] 00:26:40.119 bw ( KiB/s): min= 2052, max=26624, per=0.38%, avg=12972.00, stdev=12511.74, samples=3 00:26:40.119 iops : min= 2, max= 26, avg=12.67, stdev=12.22, samples=3 00:26:40.119 lat (msec) : >=2000=100.00% 00:26:40.119 cpu : usr=0.00%, sys=0.46%, ctx=306, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.5%, 16=11.0%, 32=21.9%, >=64=56.8% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=95.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=5.0% 00:26:40.119 issued rwts: total=146,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429678: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=24, BW=24.7MiB/s (25.9MB/s)(263MiB/10651msec) 00:26:40.119 slat (usec): min=544, max=2079.9k, avg=40233.85, stdev=243773.46 00:26:40.119 clat (msec): min=68, max=10440, avg=4064.86, stdev=2853.92 00:26:40.119 lat (msec): min=1016, max=10445, avg=4105.09, stdev=2858.76 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 1011], 5.00th=[ 1045], 10.00th=[ 1070], 20.00th=[ 1099], 00:26:40.119 | 30.00th=[ 1150], 40.00th=[ 1217], 50.00th=[ 3138], 60.00th=[ 6544], 00:26:40.119 | 70.00th=[ 6745], 80.00th=[ 7013], 90.00th=[ 7215], 95.00th=[ 7282], 00:26:40.119 | 99.00th=[10402], 99.50th=[10402], 99.90th=[10402], 99.95th=[10402], 00:26:40.119 | 99.99th=[10402] 00:26:40.119 bw ( KiB/s): min= 4096, max=122880, per=1.60%, avg=55264.00, stdev=50104.16, samples=5 00:26:40.119 iops : min= 4, max= 120, avg=53.80, stdev=48.83, samples=5 00:26:40.119 lat (msec) : 100=0.38%, 2000=42.97%, >=2000=56.65% 00:26:40.119 cpu : usr=0.00%, sys=0.56%, ctx=518, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.4%, 2=0.8%, 4=1.5%, 8=3.0%, 16=6.1%, 32=12.2%, >=64=76.0% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:26:40.119 issued rwts: total=263,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429679: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=27, BW=27.5MiB/s (28.8MB/s)(277MiB/10079msec) 00:26:40.119 slat (usec): min=44, max=2093.7k, avg=36122.75, stdev=237456.02 00:26:40.119 clat (msec): min=71, max=8990, avg=3183.22, stdev=3566.69 00:26:40.119 lat (msec): min=90, max=9009, avg=3219.34, stdev=3579.93 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 110], 5.00th=[ 205], 10.00th=[ 317], 20.00th=[ 514], 00:26:40.119 | 30.00th=[ 810], 40.00th=[ 969], 50.00th=[ 1028], 60.00th=[ 1070], 00:26:40.119 | 70.00th=[ 5269], 80.00th=[ 8926], 90.00th=[ 8926], 95.00th=[ 8926], 00:26:40.119 | 99.00th=[ 8926], 99.50th=[ 8926], 99.90th=[ 8926], 99.95th=[ 8926], 00:26:40.119 | 99.99th=[ 8926] 00:26:40.119 bw ( KiB/s): min=77824, max=124928, per=2.97%, avg=102400.00, stdev=23618.69, samples=3 00:26:40.119 iops : min= 76, max= 122, avg=100.00, stdev=23.07, samples=3 00:26:40.119 lat (msec) : 100=0.72%, 250=6.14%, 500=12.27%, 750=9.03%, 1000=16.97% 00:26:40.119 lat (msec) : 2000=21.30%, >=2000=33.57% 00:26:40.119 cpu : usr=0.01%, sys=0.90%, ctx=370, majf=0, minf=32769 00:26:40.119 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.9%, 16=5.8%, 32=11.6%, >=64=77.3% 00:26:40.119 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.119 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:26:40.119 issued rwts: total=277,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.119 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.119 job1: (groupid=0, jobs=1): err= 0: pid=429680: Fri Apr 26 01:00:45 2024 00:26:40.119 read: IOPS=66, BW=66.1MiB/s (69.3MB/s)(837MiB/12672msec) 00:26:40.119 slat (usec): min=36, max=2094.5k, avg=12622.30, stdev=116408.15 00:26:40.119 clat (msec): min=322, max=4890, avg=1431.50, stdev=1488.10 00:26:40.119 lat (msec): min=322, max=4947, avg=1444.12, stdev=1495.83 00:26:40.119 clat percentiles (msec): 00:26:40.119 | 1.00th=[ 363], 5.00th=[ 393], 10.00th=[ 426], 20.00th=[ 527], 00:26:40.119 | 30.00th=[ 634], 40.00th=[ 676], 50.00th=[ 726], 60.00th=[ 768], 00:26:40.119 | 70.00th=[ 877], 80.00th=[ 2802], 90.00th=[ 4530], 95.00th=[ 4732], 00:26:40.119 | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:26:40.119 | 99.99th=[ 4866] 00:26:40.119 bw ( KiB/s): min= 1412, max=294912, per=4.69%, avg=161493.78, stdev=87518.61, samples=9 00:26:40.119 iops : min= 1, max= 288, avg=157.67, stdev=85.55, samples=9 00:26:40.120 lat (msec) : 500=18.40%, 750=37.04%, 1000=17.44%, 2000=4.54%, >=2000=22.58% 00:26:40.120 cpu : usr=0.02%, sys=0.82%, ctx=1096, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.8%, >=64=92.5% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.120 issued rwts: total=837,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job1: (groupid=0, jobs=1): err= 0: pid=429681: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=15, BW=15.1MiB/s (15.8MB/s)(191MiB/12639msec) 00:26:40.120 slat (usec): min=337, max=2079.9k, avg=55128.64, stdev=292513.78 00:26:40.120 clat (msec): min=858, max=8105, avg=5517.09, stdev=2903.06 00:26:40.120 lat (msec): min=880, max=8105, avg=5572.22, stdev=2875.76 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 869], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 944], 00:26:40.120 | 30.00th=[ 3876], 40.00th=[ 6342], 50.00th=[ 7416], 60.00th=[ 7550], 00:26:40.120 | 70.00th=[ 7684], 80.00th=[ 7819], 90.00th=[ 8020], 95.00th=[ 8020], 00:26:40.120 | 99.00th=[ 8087], 99.50th=[ 8087], 99.90th=[ 8087], 99.95th=[ 8087], 00:26:40.120 | 99.99th=[ 8087] 00:26:40.120 bw ( KiB/s): min= 2052, max=92160, per=0.76%, avg=26215.20, stdev=37157.99, samples=5 00:26:40.120 iops : min= 2, max= 90, avg=25.60, stdev=36.29, samples=5 00:26:40.120 lat (msec) : 1000=21.47%, 2000=3.66%, >=2000=74.87% 00:26:40.120 cpu : usr=0.02%, sys=0.44%, ctx=367, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.2%, 16=8.4%, 32=16.8%, >=64=67.0% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:26:40.120 issued rwts: total=191,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job1: (groupid=0, jobs=1): err= 0: pid=429682: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=5, BW=5891KiB/s (6033kB/s)(61.0MiB/10603msec) 00:26:40.120 slat (usec): min=327, max=2131.4k, avg=172677.01, stdev=549519.63 00:26:40.120 clat (msec): min=69, max=10575, avg=4440.95, stdev=3500.81 00:26:40.120 lat (msec): min=1938, max=10602, avg=4613.63, stdev=3541.12 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 69], 5.00th=[ 1955], 10.00th=[ 1972], 20.00th=[ 2022], 00:26:40.120 | 30.00th=[ 2056], 40.00th=[ 2089], 50.00th=[ 2123], 60.00th=[ 2140], 00:26:40.120 | 70.00th=[ 6409], 80.00th=[ 8658], 90.00th=[10402], 95.00th=[10537], 00:26:40.120 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.120 | 99.99th=[10537] 00:26:40.120 lat (msec) : 100=1.64%, 2000=14.75%, >=2000=83.61% 00:26:40.120 cpu : usr=0.01%, sys=0.27%, ctx=102, majf=0, minf=15617 00:26:40.120 IO depths : 1=1.6%, 2=3.3%, 4=6.6%, 8=13.1%, 16=26.2%, 32=49.2%, >=64=0.0% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.120 issued rwts: total=61,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job1: (groupid=0, jobs=1): err= 0: pid=429683: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=16, BW=16.2MiB/s (17.0MB/s)(163MiB/10049msec) 00:26:40.120 slat (usec): min=94, max=2107.1k, avg=61409.83, stdev=314383.32 00:26:40.120 clat (msec): min=38, max=9773, avg=2079.90, stdev=2759.02 00:26:40.120 lat (msec): min=55, max=9787, avg=2141.31, stdev=2821.48 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 56], 5.00th=[ 84], 10.00th=[ 136], 20.00th=[ 527], 00:26:40.120 | 30.00th=[ 835], 40.00th=[ 1045], 50.00th=[ 1150], 60.00th=[ 1267], 00:26:40.120 | 70.00th=[ 1401], 80.00th=[ 1536], 90.00th=[ 7886], 95.00th=[ 9731], 00:26:40.120 | 99.00th=[ 9731], 99.50th=[ 9731], 99.90th=[ 9731], 99.95th=[ 9731], 00:26:40.120 | 99.99th=[ 9731] 00:26:40.120 bw ( KiB/s): min= 6144, max=67180, per=1.06%, avg=36662.00, stdev=43158.97, samples=2 00:26:40.120 iops : min= 6, max= 65, avg=35.50, stdev=41.72, samples=2 00:26:40.120 lat (msec) : 50=0.61%, 100=6.75%, 250=9.20%, 500=3.07%, 750=6.75% 00:26:40.120 lat (msec) : 1000=10.43%, 2000=45.40%, >=2000=17.79% 00:26:40.120 cpu : usr=0.00%, sys=0.85%, ctx=298, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=4.9%, 16=9.8%, 32=19.6%, >=64=61.3% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=97.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.7% 00:26:40.120 issued rwts: total=163,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job1: (groupid=0, jobs=1): err= 0: pid=429684: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=9, BW=9362KiB/s (9586kB/s)(97.0MiB/10610msec) 00:26:40.120 slat (usec): min=352, max=2091.9k, avg=108758.23, stdev=424615.67 00:26:40.120 clat (msec): min=59, max=10556, avg=9243.76, stdev=2121.47 00:26:40.120 lat (msec): min=2148, max=10609, avg=9352.52, stdev=1905.12 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 60], 5.00th=[ 4329], 10.00th=[ 6477], 20.00th=[ 9597], 00:26:40.120 | 30.00th=[ 9866], 40.00th=[ 9866], 50.00th=[10000], 60.00th=[10134], 00:26:40.120 | 70.00th=[10134], 80.00th=[10268], 90.00th=[10402], 95.00th=[10537], 00:26:40.120 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.120 | 99.99th=[10537] 00:26:40.120 lat (msec) : 100=1.03%, >=2000=98.97% 00:26:40.120 cpu : usr=0.00%, sys=0.43%, ctx=222, majf=0, minf=24833 00:26:40.120 IO depths : 1=1.0%, 2=2.1%, 4=4.1%, 8=8.2%, 16=16.5%, 32=33.0%, >=64=35.1% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.120 issued rwts: total=97,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job2: (groupid=0, jobs=1): err= 0: pid=429699: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=24, BW=24.0MiB/s (25.2MB/s)(255MiB/10614msec) 00:26:40.120 slat (usec): min=52, max=2103.9k, avg=41287.84, stdev=256530.98 00:26:40.120 clat (msec): min=83, max=10593, avg=4961.63, stdev=3631.86 00:26:40.120 lat (msec): min=903, max=10594, avg=5002.92, stdev=3625.10 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 902], 5.00th=[ 944], 10.00th=[ 1028], 20.00th=[ 1150], 00:26:40.120 | 30.00th=[ 1301], 40.00th=[ 1502], 50.00th=[ 4329], 60.00th=[ 8557], 00:26:40.120 | 70.00th=[ 8792], 80.00th=[ 8792], 90.00th=[ 8926], 95.00th=[ 9060], 00:26:40.120 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.120 | 99.99th=[10537] 00:26:40.120 bw ( KiB/s): min= 6144, max=190464, per=1.26%, avg=43349.33, stdev=72250.20, samples=6 00:26:40.120 iops : min= 6, max= 186, avg=42.33, stdev=70.56, samples=6 00:26:40.120 lat (msec) : 100=0.39%, 1000=8.24%, 2000=32.94%, >=2000=58.43% 00:26:40.120 cpu : usr=0.00%, sys=0.75%, ctx=443, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.3%, 32=12.5%, >=64=75.3% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:26:40.120 issued rwts: total=255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job2: (groupid=0, jobs=1): err= 0: pid=429700: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=45, BW=45.8MiB/s (48.1MB/s)(485MiB/10580msec) 00:26:40.120 slat (usec): min=34, max=2078.0k, avg=20660.42, stdev=155717.61 00:26:40.120 clat (msec): min=558, max=8992, avg=2122.92, stdev=1918.22 00:26:40.120 lat (msec): min=611, max=8999, avg=2143.58, stdev=1937.20 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 617], 5.00th=[ 701], 10.00th=[ 751], 20.00th=[ 802], 00:26:40.120 | 30.00th=[ 860], 40.00th=[ 978], 50.00th=[ 1183], 60.00th=[ 1234], 00:26:40.120 | 70.00th=[ 1267], 80.00th=[ 5067], 90.00th=[ 5134], 95.00th=[ 5201], 00:26:40.120 | 99.00th=[ 7148], 99.50th=[ 8926], 99.90th=[ 8926], 99.95th=[ 8926], 00:26:40.120 | 99.99th=[ 8926] 00:26:40.120 bw ( KiB/s): min= 6144, max=149504, per=2.49%, avg=85609.12, stdev=53568.30, samples=8 00:26:40.120 iops : min= 6, max= 146, avg=83.50, stdev=52.22, samples=8 00:26:40.120 lat (msec) : 750=9.07%, 1000=31.75%, 2000=30.93%, >=2000=28.25% 00:26:40.120 cpu : usr=0.00%, sys=0.64%, ctx=739, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=6.6%, >=64=87.0% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.120 issued rwts: total=485,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job2: (groupid=0, jobs=1): err= 0: pid=429701: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=107, BW=107MiB/s (113MB/s)(1355MiB/12622msec) 00:26:40.120 slat (usec): min=37, max=2093.3k, avg=7755.58, stdev=98096.66 00:26:40.120 clat (msec): min=238, max=8805, avg=1125.80, stdev=2404.37 00:26:40.120 lat (msec): min=239, max=8806, avg=1133.56, stdev=2412.48 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 241], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 245], 00:26:40.120 | 30.00th=[ 247], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 257], 00:26:40.120 | 70.00th=[ 485], 80.00th=[ 609], 90.00th=[ 986], 95.00th=[ 8658], 00:26:40.120 | 99.00th=[ 8792], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:26:40.120 | 99.99th=[ 8792] 00:26:40.120 bw ( KiB/s): min= 2052, max=528384, per=6.64%, avg=228631.64, stdev=238399.97, samples=11 00:26:40.120 iops : min= 2, max= 516, avg=223.27, stdev=232.81, samples=11 00:26:40.120 lat (msec) : 250=44.87%, 500=25.98%, 750=16.38%, 1000=2.88%, >=2000=9.89% 00:26:40.120 cpu : usr=0.01%, sys=0.81%, ctx=1471, majf=0, minf=32769 00:26:40.120 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.4%, >=64=95.4% 00:26:40.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.120 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.120 issued rwts: total=1355,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.120 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.120 job2: (groupid=0, jobs=1): err= 0: pid=429702: Fri Apr 26 01:00:45 2024 00:26:40.120 read: IOPS=6, BW=6522KiB/s (6679kB/s)(81.0MiB/12717msec) 00:26:40.120 slat (usec): min=706, max=2111.1k, avg=131041.45, stdev=480426.79 00:26:40.120 clat (msec): min=2102, max=12714, avg=11595.99, stdev=2469.91 00:26:40.120 lat (msec): min=4174, max=12716, avg=11727.03, stdev=2229.82 00:26:40.120 clat percentiles (msec): 00:26:40.120 | 1.00th=[ 2106], 5.00th=[ 4212], 10.00th=[ 8490], 20.00th=[12281], 00:26:40.120 | 30.00th=[12416], 40.00th=[12550], 50.00th=[12550], 60.00th=[12684], 00:26:40.120 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:26:40.120 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:26:40.120 | 99.99th=[12684] 00:26:40.121 lat (msec) : >=2000=100.00% 00:26:40.121 cpu : usr=0.01%, sys=0.49%, ctx=172, majf=0, minf=20737 00:26:40.121 IO depths : 1=1.2%, 2=2.5%, 4=4.9%, 8=9.9%, 16=19.8%, 32=39.5%, >=64=22.2% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.121 issued rwts: total=81,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429703: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=3, BW=3396KiB/s (3478kB/s)(35.0MiB/10553msec) 00:26:40.121 slat (usec): min=464, max=2121.8k, avg=299896.08, stdev=721442.05 00:26:40.121 clat (msec): min=56, max=10550, avg=8738.12, stdev=2956.08 00:26:40.121 lat (msec): min=2074, max=10552, avg=9038.02, stdev=2554.55 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 57], 5.00th=[ 2072], 10.00th=[ 4245], 20.00th=[ 6409], 00:26:40.121 | 30.00th=[ 8557], 40.00th=[10402], 50.00th=[10402], 60.00th=[10537], 00:26:40.121 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10537], 95.00th=[10537], 00:26:40.121 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.121 | 99.99th=[10537] 00:26:40.121 lat (msec) : 100=2.86%, >=2000=97.14% 00:26:40.121 cpu : usr=0.00%, sys=0.21%, ctx=63, majf=0, minf=8961 00:26:40.121 IO depths : 1=2.9%, 2=5.7%, 4=11.4%, 8=22.9%, 16=45.7%, 32=11.4%, >=64=0.0% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.121 issued rwts: total=35,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429704: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=49, BW=49.1MiB/s (51.5MB/s)(623MiB/12676msec) 00:26:40.121 slat (usec): min=43, max=2086.7k, avg=16971.58, stdev=127645.56 00:26:40.121 clat (msec): min=403, max=7961, avg=2375.30, stdev=2699.60 00:26:40.121 lat (msec): min=403, max=7962, avg=2392.27, stdev=2705.46 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 414], 5.00th=[ 443], 10.00th=[ 468], 20.00th=[ 617], 00:26:40.121 | 30.00th=[ 969], 40.00th=[ 1183], 50.00th=[ 1234], 60.00th=[ 1250], 00:26:40.121 | 70.00th=[ 1469], 80.00th=[ 4212], 90.00th=[ 7752], 95.00th=[ 7819], 00:26:40.121 | 99.00th=[ 7953], 99.50th=[ 7953], 99.90th=[ 7953], 99.95th=[ 7953], 00:26:40.121 | 99.99th=[ 7953] 00:26:40.121 bw ( KiB/s): min= 1412, max=286720, per=2.68%, avg=92279.00, stdev=85006.56, samples=11 00:26:40.121 iops : min= 1, max= 280, avg=90.00, stdev=83.10, samples=11 00:26:40.121 lat (msec) : 500=17.01%, 750=6.90%, 1000=6.58%, 2000=48.31%, >=2000=21.19% 00:26:40.121 cpu : usr=0.00%, sys=0.74%, ctx=1113, majf=0, minf=32769 00:26:40.121 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.1%, >=64=89.9% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.121 issued rwts: total=623,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429705: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=2, BW=2516KiB/s (2576kB/s)(31.0MiB/12619msec) 00:26:40.121 slat (usec): min=573, max=2105.5k, avg=339043.42, stdev=756960.63 00:26:40.121 clat (msec): min=2107, max=12617, avg=9591.34, stdev=3456.23 00:26:40.121 lat (msec): min=4167, max=12618, avg=9930.39, stdev=3203.97 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 2106], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:26:40.121 | 30.00th=[ 8490], 40.00th=[ 8557], 50.00th=[10671], 60.00th=[12550], 00:26:40.121 | 70.00th=[12550], 80.00th=[12550], 90.00th=[12550], 95.00th=[12684], 00:26:40.121 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:26:40.121 | 99.99th=[12684] 00:26:40.121 lat (msec) : >=2000=100.00% 00:26:40.121 cpu : usr=0.01%, sys=0.13%, ctx=75, majf=0, minf=7937 00:26:40.121 IO depths : 1=3.2%, 2=6.5%, 4=12.9%, 8=25.8%, 16=51.6%, 32=0.0%, >=64=0.0% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:40.121 issued rwts: total=31,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429706: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=3, BW=3210KiB/s (3287kB/s)(33.0MiB/10526msec) 00:26:40.121 slat (usec): min=410, max=2087.8k, avg=317236.78, stdev=729166.56 00:26:40.121 clat (msec): min=56, max=10452, avg=6500.83, stdev=3006.08 00:26:40.121 lat (msec): min=2074, max=10524, avg=6818.06, stdev=2853.22 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 56], 5.00th=[ 2072], 10.00th=[ 2140], 20.00th=[ 4245], 00:26:40.121 | 30.00th=[ 4329], 40.00th=[ 6409], 50.00th=[ 6409], 60.00th=[ 8557], 00:26:40.121 | 70.00th=[ 8557], 80.00th=[ 8557], 90.00th=[10402], 95.00th=[10402], 00:26:40.121 | 99.00th=[10402], 99.50th=[10402], 99.90th=[10402], 99.95th=[10402], 00:26:40.121 | 99.99th=[10402] 00:26:40.121 lat (msec) : 100=3.03%, >=2000=96.97% 00:26:40.121 cpu : usr=0.00%, sys=0.18%, ctx=73, majf=0, minf=8449 00:26:40.121 IO depths : 1=3.0%, 2=6.1%, 4=12.1%, 8=24.2%, 16=48.5%, 32=6.1%, >=64=0.0% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.121 issued rwts: total=33,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429707: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=82, BW=82.7MiB/s (86.8MB/s)(878MiB/10612msec) 00:26:40.121 slat (usec): min=49, max=1996.5k, avg=12022.57, stdev=96303.82 00:26:40.121 clat (msec): min=53, max=3991, avg=1447.73, stdev=1135.28 00:26:40.121 lat (msec): min=537, max=4005, avg=1459.76, stdev=1138.13 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 542], 5.00th=[ 575], 10.00th=[ 609], 20.00th=[ 642], 00:26:40.121 | 30.00th=[ 667], 40.00th=[ 693], 50.00th=[ 785], 60.00th=[ 995], 00:26:40.121 | 70.00th=[ 1536], 80.00th=[ 2534], 90.00th=[ 3675], 95.00th=[ 3910], 00:26:40.121 | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], 00:26:40.121 | 99.99th=[ 3977] 00:26:40.121 bw ( KiB/s): min= 8192, max=225280, per=3.43%, avg=118153.85, stdev=81403.75, samples=13 00:26:40.121 iops : min= 8, max= 220, avg=115.38, stdev=79.50, samples=13 00:26:40.121 lat (msec) : 100=0.11%, 750=48.75%, 1000=13.55%, 2000=8.66%, >=2000=28.93% 00:26:40.121 cpu : usr=0.00%, sys=0.99%, ctx=1319, majf=0, minf=32769 00:26:40.121 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=0.9%, 16=1.8%, 32=3.6%, >=64=92.8% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.121 issued rwts: total=878,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429708: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=11, BW=11.4MiB/s (12.0MB/s)(122MiB/10691msec) 00:26:40.121 slat (usec): min=642, max=2067.4k, avg=87017.65, stdev=392464.11 00:26:40.121 clat (msec): min=74, max=10689, avg=8360.62, stdev=2869.53 00:26:40.121 lat (msec): min=2140, max=10690, avg=8447.64, stdev=2775.60 00:26:40.121 clat percentiles (msec): 00:26:40.121 | 1.00th=[ 2140], 5.00th=[ 2198], 10.00th=[ 4329], 20.00th=[ 6275], 00:26:40.121 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[10537], 60.00th=[10537], 00:26:40.121 | 70.00th=[10671], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:26:40.121 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:26:40.121 | 99.99th=[10671] 00:26:40.121 lat (msec) : 100=0.82%, >=2000=99.18% 00:26:40.121 cpu : usr=0.01%, sys=0.84%, ctx=161, majf=0, minf=31233 00:26:40.121 IO depths : 1=0.8%, 2=1.6%, 4=3.3%, 8=6.6%, 16=13.1%, 32=26.2%, >=64=48.4% 00:26:40.121 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.121 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.121 issued rwts: total=122,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.121 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.121 job2: (groupid=0, jobs=1): err= 0: pid=429709: Fri Apr 26 01:00:45 2024 00:26:40.121 read: IOPS=2, BW=2588KiB/s (2650kB/s)(32.0MiB/12660msec) 00:26:40.121 slat (usec): min=441, max=2113.3k, avg=329688.80, stdev=747380.15 00:26:40.121 clat (msec): min=2109, max=12659, avg=10096.43, stdev=3371.43 00:26:40.122 lat (msec): min=4169, max=12659, avg=10426.12, stdev=3067.32 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 2106], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:26:40.122 | 30.00th=[ 8490], 40.00th=[10671], 50.00th=[12550], 60.00th=[12684], 00:26:40.122 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:26:40.122 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:26:40.122 | 99.99th=[12684] 00:26:40.122 lat (msec) : >=2000=100.00% 00:26:40.122 cpu : usr=0.00%, sys=0.13%, ctx=69, majf=0, minf=8193 00:26:40.122 IO depths : 1=3.1%, 2=6.2%, 4=12.5%, 8=25.0%, 16=50.0%, 32=3.1%, >=64=0.0% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:26:40.122 issued rwts: total=32,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job2: (groupid=0, jobs=1): err= 0: pid=429710: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=24, BW=24.2MiB/s (25.4MB/s)(255MiB/10546msec) 00:26:40.122 slat (usec): min=534, max=2098.3k, avg=41101.38, stdev=245652.46 00:26:40.122 clat (msec): min=64, max=5458, avg=3161.17, stdev=1917.55 00:26:40.122 lat (msec): min=972, max=5466, avg=3202.27, stdev=1908.57 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 969], 5.00th=[ 986], 10.00th=[ 1003], 20.00th=[ 1003], 00:26:40.122 | 30.00th=[ 1011], 40.00th=[ 1133], 50.00th=[ 3440], 60.00th=[ 4732], 00:26:40.122 | 70.00th=[ 4933], 80.00th=[ 5067], 90.00th=[ 5269], 95.00th=[ 5403], 00:26:40.122 | 99.00th=[ 5470], 99.50th=[ 5470], 99.90th=[ 5470], 99.95th=[ 5470], 00:26:40.122 | 99.99th=[ 5470] 00:26:40.122 bw ( KiB/s): min= 4096, max=131072, per=1.89%, avg=65024.00, stdev=65115.99, samples=4 00:26:40.122 iops : min= 4, max= 128, avg=63.50, stdev=63.59, samples=4 00:26:40.122 lat (msec) : 100=0.39%, 1000=7.45%, 2000=33.33%, >=2000=58.82% 00:26:40.122 cpu : usr=0.00%, sys=0.56%, ctx=560, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.3%, 32=12.5%, >=64=75.3% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:26:40.122 issued rwts: total=255,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job2: (groupid=0, jobs=1): err= 0: pid=429712: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=44, BW=44.2MiB/s (46.4MB/s)(468MiB/10581msec) 00:26:40.122 slat (usec): min=59, max=2066.3k, avg=22448.01, stdev=186027.85 00:26:40.122 clat (msec): min=73, max=4762, avg=1368.74, stdev=1027.64 00:26:40.122 lat (msec): min=545, max=6672, avg=1391.19, stdev=1054.96 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 542], 5.00th=[ 558], 10.00th=[ 575], 20.00th=[ 617], 00:26:40.122 | 30.00th=[ 642], 40.00th=[ 659], 50.00th=[ 676], 60.00th=[ 709], 00:26:40.122 | 70.00th=[ 2366], 80.00th=[ 2601], 90.00th=[ 2702], 95.00th=[ 2802], 00:26:40.122 | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], 00:26:40.122 | 99.99th=[ 4732] 00:26:40.122 bw ( KiB/s): min=147456, max=198656, per=5.05%, avg=174080.00, stdev=21349.03, samples=4 00:26:40.122 iops : min= 144, max= 194, avg=170.00, stdev=20.85, samples=4 00:26:40.122 lat (msec) : 100=0.21%, 750=63.68%, >=2000=36.11% 00:26:40.122 cpu : usr=0.00%, sys=0.75%, ctx=438, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.5% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.122 issued rwts: total=468,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job3: (groupid=0, jobs=1): err= 0: pid=429717: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=44, BW=44.5MiB/s (46.7MB/s)(447MiB/10047msec) 00:26:40.122 slat (usec): min=65, max=2098.0k, avg=22368.40, stdev=170516.13 00:26:40.122 clat (msec): min=45, max=7858, avg=2668.98, stdev=3114.17 00:26:40.122 lat (msec): min=55, max=7860, avg=2691.35, stdev=3121.60 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 73], 5.00th=[ 171], 10.00th=[ 279], 20.00th=[ 567], 00:26:40.122 | 30.00th=[ 726], 40.00th=[ 785], 50.00th=[ 827], 60.00th=[ 944], 00:26:40.122 | 70.00th=[ 3071], 80.00th=[ 7550], 90.00th=[ 7752], 95.00th=[ 7819], 00:26:40.122 | 99.00th=[ 7819], 99.50th=[ 7886], 99.90th=[ 7886], 99.95th=[ 7886], 00:26:40.122 | 99.99th=[ 7886] 00:26:40.122 bw ( KiB/s): min= 6144, max=169984, per=2.11%, avg=72817.78, stdev=73629.17, samples=9 00:26:40.122 iops : min= 6, max= 166, avg=71.11, stdev=71.90, samples=9 00:26:40.122 lat (msec) : 50=0.22%, 100=2.24%, 250=5.82%, 500=9.17%, 750=15.88% 00:26:40.122 lat (msec) : 1000=30.43%, 2000=6.04%, >=2000=30.20% 00:26:40.122 cpu : usr=0.02%, sys=1.18%, ctx=535, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.9% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.122 issued rwts: total=447,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job3: (groupid=0, jobs=1): err= 0: pid=429718: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=9, BW=9933KiB/s (10.2MB/s)(103MiB/10618msec) 00:26:40.122 slat (usec): min=386, max=2080.8k, avg=102496.50, stdev=414658.33 00:26:40.122 clat (msec): min=59, max=10613, avg=6903.63, stdev=3674.33 00:26:40.122 lat (msec): min=1739, max=10617, avg=7006.13, stdev=3628.50 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 1737], 5.00th=[ 1787], 10.00th=[ 1888], 20.00th=[ 2072], 00:26:40.122 | 30.00th=[ 4144], 40.00th=[ 4329], 50.00th=[ 8557], 60.00th=[10402], 00:26:40.122 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10537], 95.00th=[10671], 00:26:40.122 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:26:40.122 | 99.99th=[10671] 00:26:40.122 lat (msec) : 100=0.97%, 2000=15.53%, >=2000=83.50% 00:26:40.122 cpu : usr=0.00%, sys=0.66%, ctx=150, majf=0, minf=26369 00:26:40.122 IO depths : 1=1.0%, 2=1.9%, 4=3.9%, 8=7.8%, 16=15.5%, 32=31.1%, >=64=38.8% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.122 issued rwts: total=103,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job3: (groupid=0, jobs=1): err= 0: pid=429719: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=66, BW=66.4MiB/s (69.6MB/s)(706MiB/10636msec) 00:26:40.122 slat (usec): min=42, max=2074.3k, avg=14920.35, stdev=116114.55 00:26:40.122 clat (msec): min=100, max=4388, avg=1709.62, stdev=1322.05 00:26:40.122 lat (msec): min=328, max=6420, avg=1724.54, stdev=1331.13 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 334], 5.00th=[ 342], 10.00th=[ 351], 20.00th=[ 435], 00:26:40.122 | 30.00th=[ 575], 40.00th=[ 743], 50.00th=[ 1167], 60.00th=[ 1754], 00:26:40.122 | 70.00th=[ 3037], 80.00th=[ 3205], 90.00th=[ 3540], 95.00th=[ 3910], 00:26:40.122 | 99.00th=[ 4245], 99.50th=[ 4329], 99.90th=[ 4396], 99.95th=[ 4396], 00:26:40.122 | 99.99th=[ 4396] 00:26:40.122 bw ( KiB/s): min= 6144, max=378880, per=3.82%, avg=131527.11, stdev=107650.49, samples=9 00:26:40.122 iops : min= 6, max= 370, avg=128.44, stdev=105.13, samples=9 00:26:40.122 lat (msec) : 250=0.14%, 500=22.80%, 750=17.42%, 1000=6.09%, 2000=16.29% 00:26:40.122 lat (msec) : >=2000=37.25% 00:26:40.122 cpu : usr=0.05%, sys=0.88%, ctx=1618, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.3%, 32=4.5%, >=64=91.1% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.122 issued rwts: total=706,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job3: (groupid=0, jobs=1): err= 0: pid=429720: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=21, BW=21.5MiB/s (22.6MB/s)(272MiB/12636msec) 00:26:40.122 slat (usec): min=40, max=2080.6k, avg=38647.99, stdev=248034.44 00:26:40.122 clat (msec): min=607, max=11196, avg=5488.42, stdev=4578.30 00:26:40.122 lat (msec): min=610, max=11205, avg=5527.07, stdev=4582.12 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 609], 5.00th=[ 634], 10.00th=[ 651], 20.00th=[ 684], 00:26:40.122 | 30.00th=[ 810], 40.00th=[ 1116], 50.00th=[ 4933], 60.00th=[ 7080], 00:26:40.122 | 70.00th=[10805], 80.00th=[10939], 90.00th=[11073], 95.00th=[11073], 00:26:40.122 | 99.00th=[11208], 99.50th=[11208], 99.90th=[11208], 99.95th=[11208], 00:26:40.122 | 99.99th=[11208] 00:26:40.122 bw ( KiB/s): min= 1469, max=167936, per=1.23%, avg=42340.14, stdev=59372.25, samples=7 00:26:40.122 iops : min= 1, max= 164, avg=41.29, stdev=58.03, samples=7 00:26:40.122 lat (msec) : 750=25.00%, 1000=11.40%, 2000=5.88%, >=2000=57.72% 00:26:40.122 cpu : usr=0.00%, sys=0.51%, ctx=589, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.9%, 32=11.8%, >=64=76.8% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:26:40.122 issued rwts: total=272,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.122 job3: (groupid=0, jobs=1): err= 0: pid=429721: Fri Apr 26 01:00:45 2024 00:26:40.122 read: IOPS=37, BW=38.0MiB/s (39.8MB/s)(403MiB/10610msec) 00:26:40.122 slat (usec): min=1120, max=2082.8k, avg=26072.75, stdev=177029.13 00:26:40.122 clat (msec): min=101, max=7298, avg=2977.44, stdev=2605.89 00:26:40.122 lat (msec): min=877, max=7319, avg=3003.52, stdev=2605.81 00:26:40.122 clat percentiles (msec): 00:26:40.122 | 1.00th=[ 877], 5.00th=[ 953], 10.00th=[ 986], 20.00th=[ 1011], 00:26:40.122 | 30.00th=[ 1053], 40.00th=[ 1116], 50.00th=[ 1334], 60.00th=[ 1687], 00:26:40.122 | 70.00th=[ 6409], 80.00th=[ 6745], 90.00th=[ 6946], 95.00th=[ 7080], 00:26:40.122 | 99.00th=[ 7215], 99.50th=[ 7282], 99.90th=[ 7282], 99.95th=[ 7282], 00:26:40.122 | 99.99th=[ 7282] 00:26:40.122 bw ( KiB/s): min= 4096, max=182272, per=2.34%, avg=80457.14, stdev=67952.40, samples=7 00:26:40.122 iops : min= 4, max= 178, avg=78.57, stdev=66.36, samples=7 00:26:40.122 lat (msec) : 250=0.25%, 1000=15.14%, 2000=50.87%, >=2000=33.75% 00:26:40.122 cpu : usr=0.01%, sys=0.79%, ctx=1645, majf=0, minf=32769 00:26:40.122 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=2.0%, 16=4.0%, 32=7.9%, >=64=84.4% 00:26:40.122 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.122 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:26:40.122 issued rwts: total=403,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.122 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429722: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=11, BW=12.0MiB/s (12.6MB/s)(128MiB/10692msec) 00:26:40.123 slat (usec): min=373, max=2056.9k, avg=82855.41, stdev=387078.64 00:26:40.123 clat (msec): min=85, max=10689, avg=8411.44, stdev=3081.95 00:26:40.123 lat (msec): min=2129, max=10689, avg=8494.29, stdev=2997.76 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 2123], 5.00th=[ 2165], 10.00th=[ 2232], 20.00th=[ 4396], 00:26:40.123 | 30.00th=[ 6544], 40.00th=[10402], 50.00th=[10537], 60.00th=[10537], 00:26:40.123 | 70.00th=[10537], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:26:40.123 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:26:40.123 | 99.99th=[10671] 00:26:40.123 lat (msec) : 100=0.78%, >=2000=99.22% 00:26:40.123 cpu : usr=0.00%, sys=0.80%, ctx=127, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.8%, 2=1.6%, 4=3.1%, 8=6.2%, 16=12.5%, 32=25.0%, >=64=50.8% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=50.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=50.0% 00:26:40.123 issued rwts: total=128,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429723: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=48, BW=48.6MiB/s (50.9MB/s)(518MiB/10665msec) 00:26:40.123 slat (usec): min=29, max=2090.7k, avg=20390.14, stdev=156590.24 00:26:40.123 clat (msec): min=101, max=7404, avg=2420.15, stdev=2636.62 00:26:40.123 lat (msec): min=609, max=7405, avg=2440.54, stdev=2640.54 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 609], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], 00:26:40.123 | 30.00th=[ 667], 40.00th=[ 676], 50.00th=[ 978], 60.00th=[ 1452], 00:26:40.123 | 70.00th=[ 1636], 80.00th=[ 6879], 90.00th=[ 7148], 95.00th=[ 7282], 00:26:40.123 | 99.00th=[ 7416], 99.50th=[ 7416], 99.90th=[ 7416], 99.95th=[ 7416], 00:26:40.123 | 99.99th=[ 7416] 00:26:40.123 bw ( KiB/s): min= 2048, max=219136, per=2.58%, avg=88746.67, stdev=92676.24, samples=9 00:26:40.123 iops : min= 2, max= 214, avg=86.67, stdev=90.50, samples=9 00:26:40.123 lat (msec) : 250=0.19%, 750=45.37%, 1000=5.21%, 2000=23.17%, >=2000=26.06% 00:26:40.123 cpu : usr=0.01%, sys=0.83%, ctx=835, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.2%, >=64=87.8% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.123 issued rwts: total=518,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429724: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=71, BW=71.4MiB/s (74.9MB/s)(761MiB/10659msec) 00:26:40.123 slat (usec): min=40, max=2062.1k, avg=13870.25, stdev=115416.80 00:26:40.123 clat (msec): min=101, max=6603, avg=1646.83, stdev=1485.55 00:26:40.123 lat (msec): min=503, max=6605, avg=1660.70, stdev=1493.08 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 506], 5.00th=[ 523], 10.00th=[ 609], 20.00th=[ 651], 00:26:40.123 | 30.00th=[ 709], 40.00th=[ 768], 50.00th=[ 827], 60.00th=[ 844], 00:26:40.123 | 70.00th=[ 2668], 80.00th=[ 3004], 90.00th=[ 3910], 95.00th=[ 4212], 00:26:40.123 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], 00:26:40.123 | 99.99th=[ 6611] 00:26:40.123 bw ( KiB/s): min= 2048, max=249856, per=3.14%, avg=108020.75, stdev=84646.09, samples=12 00:26:40.123 iops : min= 2, max= 244, avg=105.42, stdev=82.70, samples=12 00:26:40.123 lat (msec) : 250=0.13%, 750=37.58%, 1000=27.60%, 2000=4.07%, >=2000=30.62% 00:26:40.123 cpu : usr=0.01%, sys=0.86%, ctx=1838, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.1%, 32=4.2%, >=64=91.7% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.123 issued rwts: total=761,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429725: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=57, BW=57.8MiB/s (60.6MB/s)(616MiB/10664msec) 00:26:40.123 slat (usec): min=30, max=2041.9k, avg=17144.68, stdev=121832.55 00:26:40.123 clat (msec): min=100, max=6539, avg=2052.23, stdev=1583.69 00:26:40.123 lat (msec): min=460, max=6549, avg=2069.37, stdev=1587.58 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 460], 5.00th=[ 464], 10.00th=[ 542], 20.00th=[ 659], 00:26:40.123 | 30.00th=[ 969], 40.00th=[ 1301], 50.00th=[ 1821], 60.00th=[ 1938], 00:26:40.123 | 70.00th=[ 2089], 80.00th=[ 3977], 90.00th=[ 4396], 95.00th=[ 5873], 00:26:40.123 | 99.00th=[ 6007], 99.50th=[ 6007], 99.90th=[ 6544], 99.95th=[ 6544], 00:26:40.123 | 99.99th=[ 6544] 00:26:40.123 bw ( KiB/s): min=24576, max=225280, per=2.90%, avg=99942.40, stdev=71297.34, samples=10 00:26:40.123 iops : min= 24, max= 220, avg=97.60, stdev=69.63, samples=10 00:26:40.123 lat (msec) : 250=0.16%, 500=6.82%, 750=17.86%, 1000=6.33%, 2000=34.74% 00:26:40.123 lat (msec) : >=2000=34.09% 00:26:40.123 cpu : usr=0.00%, sys=1.02%, ctx=1797, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.8% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.123 issued rwts: total=616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429726: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=75, BW=75.0MiB/s (78.6MB/s)(793MiB/10573msec) 00:26:40.123 slat (usec): min=345, max=2066.0k, avg=13212.74, stdev=110029.92 00:26:40.123 clat (msec): min=92, max=5115, avg=1469.98, stdev=1451.25 00:26:40.123 lat (msec): min=360, max=5117, avg=1483.19, stdev=1456.67 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 372], 5.00th=[ 401], 10.00th=[ 435], 20.00th=[ 600], 00:26:40.123 | 30.00th=[ 718], 40.00th=[ 810], 50.00th=[ 877], 60.00th=[ 902], 00:26:40.123 | 70.00th=[ 927], 80.00th=[ 2056], 90.00th=[ 4597], 95.00th=[ 4866], 00:26:40.123 | 99.00th=[ 5067], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], 00:26:40.123 | 99.99th=[ 5134] 00:26:40.123 bw ( KiB/s): min=16384, max=307200, per=3.95%, avg=136192.00, stdev=83045.78, samples=10 00:26:40.123 iops : min= 16, max= 300, avg=133.00, stdev=81.10, samples=10 00:26:40.123 lat (msec) : 100=0.13%, 500=14.75%, 750=21.69%, 1000=38.08%, 2000=4.41% 00:26:40.123 lat (msec) : >=2000=20.93% 00:26:40.123 cpu : usr=0.02%, sys=0.79%, ctx=1761, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.1% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.123 issued rwts: total=793,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429727: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=6, BW=6196KiB/s (6345kB/s)(77.0MiB/12726msec) 00:26:40.123 slat (usec): min=704, max=2074.8k, avg=137740.91, stdev=501248.48 00:26:40.123 clat (msec): min=2118, max=12723, avg=10572.55, stdev=3097.71 00:26:40.123 lat (msec): min=4167, max=12725, avg=10710.29, stdev=2949.11 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4245], 20.00th=[ 8490], 00:26:40.123 | 30.00th=[10671], 40.00th=[10671], 50.00th=[12550], 60.00th=[12684], 00:26:40.123 | 70.00th=[12684], 80.00th=[12684], 90.00th=[12684], 95.00th=[12684], 00:26:40.123 | 99.00th=[12684], 99.50th=[12684], 99.90th=[12684], 99.95th=[12684], 00:26:40.123 | 99.99th=[12684] 00:26:40.123 lat (msec) : >=2000=100.00% 00:26:40.123 cpu : usr=0.00%, sys=0.49%, ctx=113, majf=0, minf=19713 00:26:40.123 IO depths : 1=1.3%, 2=2.6%, 4=5.2%, 8=10.4%, 16=20.8%, 32=41.6%, >=64=18.2% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.123 issued rwts: total=77,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429728: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=129, BW=129MiB/s (136MB/s)(1362MiB/10523msec) 00:26:40.123 slat (usec): min=60, max=2062.2k, avg=7340.64, stdev=56639.49 00:26:40.123 clat (msec): min=356, max=4126, avg=933.49, stdev=706.37 00:26:40.123 lat (msec): min=357, max=4253, avg=940.84, stdev=712.61 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 363], 5.00th=[ 405], 10.00th=[ 447], 20.00th=[ 506], 00:26:40.123 | 30.00th=[ 600], 40.00th=[ 634], 50.00th=[ 667], 60.00th=[ 810], 00:26:40.123 | 70.00th=[ 894], 80.00th=[ 1099], 90.00th=[ 1200], 95.00th=[ 3004], 00:26:40.123 | 99.00th=[ 3138], 99.50th=[ 3205], 99.90th=[ 3239], 99.95th=[ 4111], 00:26:40.123 | 99.99th=[ 4111] 00:26:40.123 bw ( KiB/s): min=32768, max=331776, per=4.59%, avg=158102.00, stdev=85731.89, samples=16 00:26:40.123 iops : min= 32, max= 324, avg=154.38, stdev=83.72, samples=16 00:26:40.123 lat (msec) : 500=19.24%, 750=35.68%, 1000=19.24%, 2000=16.45%, >=2000=9.40% 00:26:40.123 cpu : usr=0.02%, sys=1.15%, ctx=2452, majf=0, minf=32769 00:26:40.123 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.3%, >=64=95.4% 00:26:40.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.123 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.123 issued rwts: total=1362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.123 job3: (groupid=0, jobs=1): err= 0: pid=429729: Fri Apr 26 01:00:45 2024 00:26:40.123 read: IOPS=56, BW=56.2MiB/s (59.0MB/s)(593MiB/10544msec) 00:26:40.123 slat (usec): min=338, max=2065.3k, avg=17661.59, stdev=145535.82 00:26:40.123 clat (msec): min=68, max=7077, avg=2072.62, stdev=2425.30 00:26:40.123 lat (msec): min=419, max=7082, avg=2090.28, stdev=2429.73 00:26:40.123 clat percentiles (msec): 00:26:40.123 | 1.00th=[ 422], 5.00th=[ 456], 10.00th=[ 542], 20.00th=[ 642], 00:26:40.123 | 30.00th=[ 693], 40.00th=[ 751], 50.00th=[ 835], 60.00th=[ 1062], 00:26:40.123 | 70.00th=[ 1167], 80.00th=[ 6544], 90.00th=[ 6745], 95.00th=[ 6946], 00:26:40.123 | 99.00th=[ 7013], 99.50th=[ 7080], 99.90th=[ 7080], 99.95th=[ 7080], 00:26:40.123 | 99.99th=[ 7080] 00:26:40.123 bw ( KiB/s): min= 6144, max=235520, per=3.07%, avg=105796.89, stdev=92456.11, samples=9 00:26:40.123 iops : min= 6, max= 230, avg=103.22, stdev=90.33, samples=9 00:26:40.123 lat (msec) : 100=0.17%, 500=7.76%, 750=31.87%, 1000=16.86%, 2000=20.91% 00:26:40.123 lat (msec) : >=2000=22.43% 00:26:40.124 cpu : usr=0.02%, sys=0.76%, ctx=1728, majf=0, minf=32769 00:26:40.124 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.3%, 16=2.7%, 32=5.4%, >=64=89.4% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.124 issued rwts: total=593,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429745: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=65, BW=65.5MiB/s (68.7MB/s)(693MiB/10579msec) 00:26:40.124 slat (usec): min=61, max=2006.6k, avg=15208.28, stdev=131116.28 00:26:40.124 clat (msec): min=36, max=6620, avg=1183.40, stdev=1258.89 00:26:40.124 lat (msec): min=431, max=6625, avg=1198.61, stdev=1274.55 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 430], 5.00th=[ 460], 10.00th=[ 481], 20.00th=[ 609], 00:26:40.124 | 30.00th=[ 659], 40.00th=[ 709], 50.00th=[ 785], 60.00th=[ 860], 00:26:40.124 | 70.00th=[ 911], 80.00th=[ 1234], 90.00th=[ 1703], 95.00th=[ 4665], 00:26:40.124 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], 00:26:40.124 | 99.99th=[ 6611] 00:26:40.124 bw ( KiB/s): min=63488, max=225280, per=4.80%, avg=165209.29, stdev=56109.32, samples=7 00:26:40.124 iops : min= 62, max= 220, avg=161.14, stdev=54.82, samples=7 00:26:40.124 lat (msec) : 50=0.14%, 500=11.40%, 750=33.04%, 1000=30.30%, 2000=15.15% 00:26:40.124 lat (msec) : >=2000=9.96% 00:26:40.124 cpu : usr=0.03%, sys=1.04%, ctx=640, majf=0, minf=32769 00:26:40.124 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.124 issued rwts: total=693,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429746: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=154, BW=154MiB/s (162MB/s)(1544MiB/10012msec) 00:26:40.124 slat (usec): min=356, max=2290.6k, avg=6474.87, stdev=78145.21 00:26:40.124 clat (msec): min=11, max=3408, avg=770.72, stdev=1004.22 00:26:40.124 lat (msec): min=13, max=3420, avg=777.19, stdev=1008.16 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 36], 5.00th=[ 142], 10.00th=[ 224], 20.00th=[ 239], 00:26:40.124 | 30.00th=[ 264], 40.00th=[ 296], 50.00th=[ 317], 60.00th=[ 321], 00:26:40.124 | 70.00th=[ 397], 80.00th=[ 894], 90.00th=[ 2869], 95.00th=[ 3171], 00:26:40.124 | 99.00th=[ 3339], 99.50th=[ 3373], 99.90th=[ 3406], 99.95th=[ 3406], 00:26:40.124 | 99.99th=[ 3406] 00:26:40.124 bw ( KiB/s): min=12288, max=458752, per=6.77%, avg=233062.40, stdev=160619.15, samples=10 00:26:40.124 iops : min= 12, max= 448, avg=227.60, stdev=156.85, samples=10 00:26:40.124 lat (msec) : 20=0.32%, 50=1.23%, 100=1.94%, 250=17.75%, 500=53.04% 00:26:40.124 lat (msec) : 750=3.76%, 1000=4.02%, 2000=1.49%, >=2000=16.45% 00:26:40.124 cpu : usr=0.03%, sys=1.32%, ctx=3880, majf=0, minf=32769 00:26:40.124 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.1%, >=64=95.9% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.124 issued rwts: total=1544,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429747: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=4, BW=4453KiB/s (4560kB/s)(46.0MiB/10577msec) 00:26:40.124 slat (usec): min=463, max=2101.4k, avg=227679.95, stdev=632104.50 00:26:40.124 clat (msec): min=103, max=10575, avg=8060.02, stdev=2943.59 00:26:40.124 lat (msec): min=2133, max=10576, avg=8287.70, stdev=2710.26 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 104], 5.00th=[ 2165], 10.00th=[ 2232], 20.00th=[ 6477], 00:26:40.124 | 30.00th=[ 6544], 40.00th=[ 8658], 50.00th=[ 8658], 60.00th=[10402], 00:26:40.124 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10537], 95.00th=[10537], 00:26:40.124 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.124 | 99.99th=[10537] 00:26:40.124 lat (msec) : 250=2.17%, >=2000=97.83% 00:26:40.124 cpu : usr=0.00%, sys=0.29%, ctx=67, majf=0, minf=11777 00:26:40.124 IO depths : 1=2.2%, 2=4.3%, 4=8.7%, 8=17.4%, 16=34.8%, 32=32.6%, >=64=0.0% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.124 issued rwts: total=46,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429748: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=3, BW=3650KiB/s (3738kB/s)(38.0MiB/10660msec) 00:26:40.124 slat (usec): min=669, max=2097.2k, avg=277764.49, stdev=689718.12 00:26:40.124 clat (msec): min=104, max=10657, avg=7705.58, stdev=3516.28 00:26:40.124 lat (msec): min=2133, max=10659, avg=7983.35, stdev=3310.48 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 105], 5.00th=[ 2140], 10.00th=[ 2198], 20.00th=[ 4279], 00:26:40.124 | 30.00th=[ 6477], 40.00th=[ 8658], 50.00th=[ 8658], 60.00th=[10671], 00:26:40.124 | 70.00th=[10671], 80.00th=[10671], 90.00th=[10671], 95.00th=[10671], 00:26:40.124 | 99.00th=[10671], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:26:40.124 | 99.99th=[10671] 00:26:40.124 lat (msec) : 250=2.63%, >=2000=97.37% 00:26:40.124 cpu : usr=0.00%, sys=0.26%, ctx=90, majf=0, minf=9729 00:26:40.124 IO depths : 1=2.6%, 2=5.3%, 4=10.5%, 8=21.1%, 16=42.1%, 32=18.4%, >=64=0.0% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:26:40.124 issued rwts: total=38,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429749: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=7, BW=8060KiB/s (8253kB/s)(83.0MiB/10545msec) 00:26:40.124 slat (usec): min=669, max=2092.6k, avg=126630.21, stdev=473923.40 00:26:40.124 clat (msec): min=34, max=10542, avg=6539.15, stdev=3361.49 00:26:40.124 lat (msec): min=1911, max=10544, avg=6665.78, stdev=3311.06 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 35], 5.00th=[ 1989], 10.00th=[ 2039], 20.00th=[ 2165], 00:26:40.124 | 30.00th=[ 4245], 40.00th=[ 4329], 50.00th=[ 6409], 60.00th=[ 8557], 00:26:40.124 | 70.00th=[10402], 80.00th=[10402], 90.00th=[10537], 95.00th=[10537], 00:26:40.124 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.124 | 99.99th=[10537] 00:26:40.124 lat (msec) : 50=1.20%, 2000=4.82%, >=2000=93.98% 00:26:40.124 cpu : usr=0.00%, sys=0.57%, ctx=92, majf=0, minf=21249 00:26:40.124 IO depths : 1=1.2%, 2=2.4%, 4=4.8%, 8=9.6%, 16=19.3%, 32=38.6%, >=64=24.1% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.124 issued rwts: total=83,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429750: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=73, BW=73.6MiB/s (77.2MB/s)(782MiB/10622msec) 00:26:40.124 slat (usec): min=436, max=3940.4k, avg=13449.29, stdev=164186.44 00:26:40.124 clat (msec): min=101, max=4666, avg=1098.51, stdev=1047.83 00:26:40.124 lat (msec): min=329, max=4673, avg=1111.96, stdev=1060.24 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 330], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 338], 00:26:40.124 | 30.00th=[ 342], 40.00th=[ 460], 50.00th=[ 514], 60.00th=[ 609], 00:26:40.124 | 70.00th=[ 1452], 80.00th=[ 1921], 90.00th=[ 2836], 95.00th=[ 2937], 00:26:40.124 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:26:40.124 | 99.99th=[ 4665] 00:26:40.124 bw ( KiB/s): min=16384, max=387072, per=5.56%, avg=191341.71, stdev=122537.38, samples=7 00:26:40.124 iops : min= 16, max= 378, avg=186.86, stdev=119.67, samples=7 00:26:40.124 lat (msec) : 250=0.13%, 500=46.29%, 750=17.90%, 1000=1.02%, 2000=16.11% 00:26:40.124 lat (msec) : >=2000=18.54% 00:26:40.124 cpu : usr=0.00%, sys=1.03%, ctx=2808, majf=0, minf=32769 00:26:40.124 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.1%, >=64=91.9% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.124 issued rwts: total=782,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429751: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=13, BW=14.0MiB/s (14.6MB/s)(148MiB/10607msec) 00:26:40.124 slat (usec): min=980, max=2052.2k, avg=70956.11, stdev=350463.64 00:26:40.124 clat (msec): min=105, max=8503, avg=5170.40, stdev=1798.88 00:26:40.124 lat (msec): min=1957, max=8512, avg=5241.35, stdev=1771.48 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 1955], 5.00th=[ 1989], 10.00th=[ 2056], 20.00th=[ 2198], 00:26:40.124 | 30.00th=[ 4396], 40.00th=[ 6208], 50.00th=[ 6208], 60.00th=[ 6275], 00:26:40.124 | 70.00th=[ 6275], 80.00th=[ 6342], 90.00th=[ 6342], 95.00th=[ 6342], 00:26:40.124 | 99.00th=[ 8423], 99.50th=[ 8490], 99.90th=[ 8490], 99.95th=[ 8490], 00:26:40.124 | 99.99th=[ 8490] 00:26:40.124 bw ( KiB/s): min=40960, max=40960, per=1.19%, avg=40960.00, stdev= 0.00, samples=1 00:26:40.124 iops : min= 40, max= 40, avg=40.00, stdev= 0.00, samples=1 00:26:40.124 lat (msec) : 250=0.68%, 2000=4.73%, >=2000=94.59% 00:26:40.124 cpu : usr=0.01%, sys=0.45%, ctx=418, majf=0, minf=32769 00:26:40.124 IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.4%, 16=10.8%, 32=21.6%, >=64=57.4% 00:26:40.124 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.124 complete : 0=0.0%, 4=95.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=4.5% 00:26:40.124 issued rwts: total=148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.124 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.124 job4: (groupid=0, jobs=1): err= 0: pid=429752: Fri Apr 26 01:00:45 2024 00:26:40.124 read: IOPS=55, BW=55.7MiB/s (58.4MB/s)(588MiB/10562msec) 00:26:40.124 slat (usec): min=39, max=2053.0k, avg=17901.90, stdev=169268.96 00:26:40.124 clat (msec): min=34, max=8556, avg=1129.25, stdev=1951.22 00:26:40.124 lat (msec): min=239, max=8566, avg=1147.16, stdev=1974.30 00:26:40.124 clat percentiles (msec): 00:26:40.124 | 1.00th=[ 241], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 245], 00:26:40.124 | 30.00th=[ 245], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 249], 00:26:40.124 | 70.00th=[ 1150], 80.00th=[ 1267], 90.00th=[ 2400], 95.00th=[ 6611], 00:26:40.124 | 99.00th=[ 8557], 99.50th=[ 8557], 99.90th=[ 8557], 99.95th=[ 8557], 00:26:40.124 | 99.99th=[ 8557] 00:26:40.124 bw ( KiB/s): min=471040, max=471040, per=13.68%, avg=471040.00, stdev= 0.00, samples=2 00:26:40.125 iops : min= 460, max= 460, avg=460.00, stdev= 0.00, samples=2 00:26:40.125 lat (msec) : 50=0.17%, 250=62.07%, 500=3.57%, 2000=21.60%, >=2000=12.59% 00:26:40.125 cpu : usr=0.03%, sys=0.85%, ctx=558, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.2%, 2=0.3%, 4=0.7%, 8=1.4%, 16=2.7%, 32=5.4%, >=64=89.3% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.125 issued rwts: total=588,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job4: (groupid=0, jobs=1): err= 0: pid=429753: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=6, BW=6772KiB/s (6934kB/s)(70.0MiB/10585msec) 00:26:40.125 slat (usec): min=400, max=2090.9k, avg=149688.82, stdev=518475.43 00:26:40.125 clat (msec): min=105, max=10583, avg=6014.79, stdev=3435.00 00:26:40.125 lat (msec): min=2097, max=10584, avg=6164.48, stdev=3401.93 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 107], 5.00th=[ 2106], 10.00th=[ 2140], 20.00th=[ 2198], 00:26:40.125 | 30.00th=[ 2232], 40.00th=[ 4329], 50.00th=[ 4329], 60.00th=[ 6477], 00:26:40.125 | 70.00th=[ 8658], 80.00th=[10537], 90.00th=[10537], 95.00th=[10537], 00:26:40.125 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.125 | 99.99th=[10537] 00:26:40.125 lat (msec) : 250=1.43%, >=2000=98.57% 00:26:40.125 cpu : usr=0.00%, sys=0.41%, ctx=85, majf=0, minf=17921 00:26:40.125 IO depths : 1=1.4%, 2=2.9%, 4=5.7%, 8=11.4%, 16=22.9%, 32=45.7%, >=64=10.0% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.125 issued rwts: total=70,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job4: (groupid=0, jobs=1): err= 0: pid=429754: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=48, BW=48.4MiB/s (50.7MB/s)(484MiB/10010msec) 00:26:40.125 slat (usec): min=392, max=2083.4k, avg=20660.42, stdev=182718.79 00:26:40.125 clat (msec): min=9, max=9288, avg=519.13, stdev=1224.82 00:26:40.125 lat (msec): min=10, max=9363, avg=539.79, stdev=1289.71 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 13], 5.00th=[ 28], 10.00th=[ 47], 20.00th=[ 126], 00:26:40.125 | 30.00th=[ 188], 40.00th=[ 220], 50.00th=[ 226], 60.00th=[ 228], 00:26:40.125 | 70.00th=[ 230], 80.00th=[ 592], 90.00th=[ 885], 95.00th=[ 969], 00:26:40.125 | 99.00th=[ 7416], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:26:40.125 | 99.99th=[ 9329] 00:26:40.125 bw ( KiB/s): min=100352, max=100352, per=2.91%, avg=100352.00, stdev= 0.00, samples=1 00:26:40.125 iops : min= 98, max= 98, avg=98.00, stdev= 0.00, samples=1 00:26:40.125 lat (msec) : 10=0.21%, 20=2.89%, 50=7.23%, 100=6.61%, 250=55.37% 00:26:40.125 lat (msec) : 500=5.58%, 750=6.61%, 1000=11.57%, 2000=0.41%, >=2000=3.51% 00:26:40.125 cpu : usr=0.00%, sys=0.69%, ctx=1236, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:26:40.125 issued rwts: total=484,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job4: (groupid=0, jobs=1): err= 0: pid=429756: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=101, BW=102MiB/s (107MB/s)(1086MiB/10679msec) 00:26:40.125 slat (usec): min=61, max=2109.2k, avg=9736.92, stdev=109133.16 00:26:40.125 clat (msec): min=101, max=4697, avg=1192.45, stdev=1429.22 00:26:40.125 lat (msec): min=275, max=4700, avg=1202.18, stdev=1432.85 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 275], 5.00th=[ 279], 10.00th=[ 284], 20.00th=[ 288], 00:26:40.125 | 30.00th=[ 321], 40.00th=[ 330], 50.00th=[ 334], 60.00th=[ 397], 00:26:40.125 | 70.00th=[ 1020], 80.00th=[ 2668], 90.00th=[ 4396], 95.00th=[ 4597], 00:26:40.125 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], 00:26:40.125 | 99.99th=[ 4665] 00:26:40.125 bw ( KiB/s): min= 2048, max=438272, per=5.18%, avg=178362.18, stdev=173402.73, samples=11 00:26:40.125 iops : min= 2, max= 428, avg=174.18, stdev=169.34, samples=11 00:26:40.125 lat (msec) : 250=0.09%, 500=61.05%, 750=0.92%, 1000=7.46%, 2000=6.54% 00:26:40.125 lat (msec) : >=2000=23.94% 00:26:40.125 cpu : usr=0.00%, sys=1.27%, ctx=2836, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.2% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.125 issued rwts: total=1086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job4: (groupid=0, jobs=1): err= 0: pid=429757: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=7, BW=7520KiB/s (7701kB/s)(78.0MiB/10621msec) 00:26:40.125 slat (usec): min=353, max=2094.4k, avg=134804.94, stdev=479432.97 00:26:40.125 clat (msec): min=105, max=10601, avg=3892.95, stdev=3070.80 00:26:40.125 lat (msec): min=1737, max=10620, avg=4027.75, stdev=3132.55 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 106], 5.00th=[ 1770], 10.00th=[ 1821], 20.00th=[ 1854], 00:26:40.125 | 30.00th=[ 1938], 40.00th=[ 1989], 50.00th=[ 2072], 60.00th=[ 2165], 00:26:40.125 | 70.00th=[ 4329], 80.00th=[ 6477], 90.00th=[ 8658], 95.00th=[10537], 00:26:40.125 | 99.00th=[10537], 99.50th=[10537], 99.90th=[10537], 99.95th=[10537], 00:26:40.125 | 99.99th=[10537] 00:26:40.125 lat (msec) : 250=1.28%, 2000=41.03%, >=2000=57.69% 00:26:40.125 cpu : usr=0.00%, sys=0.46%, ctx=132, majf=0, minf=19969 00:26:40.125 IO depths : 1=1.3%, 2=2.6%, 4=5.1%, 8=10.3%, 16=20.5%, 32=41.0%, >=64=19.2% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:26:40.125 issued rwts: total=78,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job4: (groupid=0, jobs=1): err= 0: pid=429758: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=20, BW=20.7MiB/s (21.7MB/s)(220MiB/10615msec) 00:26:40.125 slat (usec): min=63, max=2099.8k, avg=47777.21, stdev=287607.49 00:26:40.125 clat (msec): min=103, max=6599, avg=2780.33, stdev=1636.36 00:26:40.125 lat (msec): min=347, max=6613, avg=2828.11, stdev=1639.46 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 347], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 363], 00:26:40.125 | 30.00th=[ 1905], 40.00th=[ 2265], 50.00th=[ 3809], 60.00th=[ 3876], 00:26:40.125 | 70.00th=[ 3943], 80.00th=[ 4010], 90.00th=[ 4077], 95.00th=[ 4077], 00:26:40.125 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], 00:26:40.125 | 99.99th=[ 6611] 00:26:40.125 bw ( KiB/s): min=38912, max=149504, per=2.74%, avg=94208.00, stdev=78200.35, samples=2 00:26:40.125 iops : min= 38, max= 146, avg=92.00, stdev=76.37, samples=2 00:26:40.125 lat (msec) : 250=0.45%, 500=23.64%, 2000=8.64%, >=2000=67.27% 00:26:40.125 cpu : usr=0.00%, sys=0.61%, ctx=223, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.5%, 2=0.9%, 4=1.8%, 8=3.6%, 16=7.3%, 32=14.5%, >=64=71.4% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.1% 00:26:40.125 issued rwts: total=220,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job5: (groupid=0, jobs=1): err= 0: pid=429767: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=136, BW=137MiB/s (144MB/s)(1380MiB/10083msec) 00:26:40.125 slat (usec): min=28, max=2169.2k, avg=7245.74, stdev=58959.01 00:26:40.125 clat (msec): min=79, max=3288, avg=895.65, stdev=776.15 00:26:40.125 lat (msec): min=82, max=3291, avg=902.89, stdev=779.37 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 133], 5.00th=[ 239], 10.00th=[ 275], 20.00th=[ 342], 00:26:40.125 | 30.00th=[ 363], 40.00th=[ 542], 50.00th=[ 802], 60.00th=[ 869], 00:26:40.125 | 70.00th=[ 953], 80.00th=[ 1083], 90.00th=[ 1368], 95.00th=[ 3071], 00:26:40.125 | 99.00th=[ 3239], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3306], 00:26:40.125 | 99.99th=[ 3306] 00:26:40.125 bw ( KiB/s): min=10240, max=393216, per=4.65%, avg=160055.88, stdev=114355.85, samples=16 00:26:40.125 iops : min= 10, max= 384, avg=156.25, stdev=111.67, samples=16 00:26:40.125 lat (msec) : 100=0.51%, 250=6.01%, 500=32.68%, 750=7.03%, 1000=28.55% 00:26:40.125 lat (msec) : 2000=16.01%, >=2000=9.20% 00:26:40.125 cpu : usr=0.03%, sys=1.52%, ctx=2150, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.3%, >=64=95.4% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.125 issued rwts: total=1380,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job5: (groupid=0, jobs=1): err= 0: pid=429768: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=90, BW=90.9MiB/s (95.4MB/s)(962MiB/10578msec) 00:26:40.125 slat (usec): min=58, max=2035.4k, avg=10879.95, stdev=113721.66 00:26:40.125 clat (msec): min=108, max=6485, avg=636.13, stdev=663.13 00:26:40.125 lat (msec): min=327, max=6534, avg=647.01, stdev=690.06 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 326], 5.00th=[ 330], 10.00th=[ 334], 20.00th=[ 338], 00:26:40.125 | 30.00th=[ 342], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 355], 00:26:40.125 | 70.00th=[ 600], 80.00th=[ 894], 90.00th=[ 1334], 95.00th=[ 1519], 00:26:40.125 | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 6477], 99.95th=[ 6477], 00:26:40.125 | 99.99th=[ 6477] 00:26:40.125 bw ( KiB/s): min=106496, max=378880, per=8.26%, avg=284672.00, stdev=106432.97, samples=6 00:26:40.125 iops : min= 104, max= 370, avg=278.00, stdev=103.94, samples=6 00:26:40.125 lat (msec) : 250=0.10%, 500=67.88%, 750=6.44%, 1000=10.08%, 2000=12.89% 00:26:40.125 lat (msec) : >=2000=2.60% 00:26:40.125 cpu : usr=0.07%, sys=0.90%, ctx=2534, majf=0, minf=32769 00:26:40.125 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.7%, 32=3.3%, >=64=93.5% 00:26:40.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.125 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.125 issued rwts: total=962,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.125 job5: (groupid=0, jobs=1): err= 0: pid=429769: Fri Apr 26 01:00:45 2024 00:26:40.125 read: IOPS=61, BW=61.8MiB/s (64.8MB/s)(655MiB/10600msec) 00:26:40.125 slat (usec): min=54, max=2146.7k, avg=16072.05, stdev=110510.68 00:26:40.125 clat (msec): min=70, max=5396, avg=1885.69, stdev=1463.28 00:26:40.125 lat (msec): min=690, max=5399, avg=1901.76, stdev=1464.42 00:26:40.125 clat percentiles (msec): 00:26:40.125 | 1.00th=[ 709], 5.00th=[ 785], 10.00th=[ 894], 20.00th=[ 1011], 00:26:40.126 | 30.00th=[ 1099], 40.00th=[ 1200], 50.00th=[ 1284], 60.00th=[ 1351], 00:26:40.126 | 70.00th=[ 1385], 80.00th=[ 2056], 90.00th=[ 4933], 95.00th=[ 5134], 00:26:40.126 | 99.00th=[ 5336], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], 00:26:40.126 | 99.99th=[ 5403] 00:26:40.126 bw ( KiB/s): min= 8192, max=192512, per=2.61%, avg=89941.33, stdev=52559.39, samples=12 00:26:40.126 iops : min= 8, max= 188, avg=87.83, stdev=51.33, samples=12 00:26:40.126 lat (msec) : 100=0.15%, 750=3.21%, 1000=12.37%, 2000=63.66%, >=2000=20.61% 00:26:40.126 cpu : usr=0.01%, sys=1.03%, ctx=2008, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.4%, 32=4.9%, >=64=90.4% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.126 issued rwts: total=655,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429770: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=65, BW=65.4MiB/s (68.5MB/s)(696MiB/10649msec) 00:26:40.126 slat (usec): min=1346, max=2153.3k, avg=15142.32, stdev=111710.31 00:26:40.126 clat (msec): min=107, max=5029, avg=1773.28, stdev=1407.43 00:26:40.126 lat (msec): min=671, max=5034, avg=1788.42, stdev=1408.06 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 676], 5.00th=[ 684], 10.00th=[ 726], 20.00th=[ 802], 00:26:40.126 | 30.00th=[ 844], 40.00th=[ 927], 50.00th=[ 1318], 60.00th=[ 1552], 00:26:40.126 | 70.00th=[ 1620], 80.00th=[ 1670], 90.00th=[ 4597], 95.00th=[ 4866], 00:26:40.126 | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], 00:26:40.126 | 99.99th=[ 5000] 00:26:40.126 bw ( KiB/s): min= 2048, max=184320, per=2.81%, avg=96931.50, stdev=66977.60, samples=12 00:26:40.126 iops : min= 2, max= 180, avg=94.58, stdev=65.34, samples=12 00:26:40.126 lat (msec) : 250=0.14%, 750=10.92%, 1000=30.75%, 2000=39.51%, >=2000=18.68% 00:26:40.126 cpu : usr=0.01%, sys=1.04%, ctx=2356, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.1%, 16=2.3%, 32=4.6%, >=64=90.9% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:26:40.126 issued rwts: total=696,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429771: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=322, BW=322MiB/s (338MB/s)(3229MiB/10013msec) 00:26:40.126 slat (usec): min=35, max=2064.9k, avg=3095.06, stdev=48717.03 00:26:40.126 clat (msec): min=12, max=4540, avg=295.77, stdev=548.46 00:26:40.126 lat (msec): min=12, max=4542, avg=298.86, stdev=553.81 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 41], 5.00th=[ 111], 10.00th=[ 112], 20.00th=[ 113], 00:26:40.126 | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 245], 60.00th=[ 251], 00:26:40.126 | 70.00th=[ 300], 80.00th=[ 376], 90.00th=[ 435], 95.00th=[ 468], 00:26:40.126 | 99.00th=[ 4463], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], 00:26:40.126 | 99.99th=[ 4530] 00:26:40.126 bw ( KiB/s): min=20480, max=1159168, per=15.37%, avg=529361.67, stdev=359847.48, samples=12 00:26:40.126 iops : min= 20, max= 1132, avg=516.92, stdev=351.44, samples=12 00:26:40.126 lat (msec) : 20=0.31%, 50=1.05%, 100=1.80%, 250=57.20%, 500=36.45% 00:26:40.126 lat (msec) : 750=1.30%, >=2000=1.89% 00:26:40.126 cpu : usr=0.07%, sys=2.06%, ctx=3189, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=1.0%, >=64=98.0% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.126 issued rwts: total=3229,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429773: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=77, BW=77.9MiB/s (81.7MB/s)(827MiB/10611msec) 00:26:40.126 slat (usec): min=46, max=1715.4k, avg=12696.44, stdev=78313.32 00:26:40.126 clat (msec): min=108, max=4708, avg=1522.51, stdev=1062.15 00:26:40.126 lat (msec): min=779, max=4713, avg=1535.20, stdev=1064.09 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 776], 5.00th=[ 793], 10.00th=[ 810], 20.00th=[ 902], 00:26:40.126 | 30.00th=[ 995], 40.00th=[ 1099], 50.00th=[ 1133], 60.00th=[ 1150], 00:26:40.126 | 70.00th=[ 1234], 80.00th=[ 1401], 90.00th=[ 3842], 95.00th=[ 4245], 00:26:40.126 | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4732], 99.95th=[ 4732], 00:26:40.126 | 99.99th=[ 4732] 00:26:40.126 bw ( KiB/s): min=14336, max=174080, per=2.97%, avg=102253.71, stdev=45966.71, samples=14 00:26:40.126 iops : min= 14, max= 170, avg=99.86, stdev=44.89, samples=14 00:26:40.126 lat (msec) : 250=0.12%, 1000=29.99%, 2000=52.96%, >=2000=16.93% 00:26:40.126 cpu : usr=0.01%, sys=0.98%, ctx=2387, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=1.9%, 32=3.9%, >=64=92.4% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.126 issued rwts: total=827,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429774: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=25, BW=25.8MiB/s (27.0MB/s)(274MiB/10623msec) 00:26:40.126 slat (usec): min=599, max=2049.7k, avg=38380.48, stdev=227125.00 00:26:40.126 clat (msec): min=105, max=5414, avg=3235.48, stdev=1666.57 00:26:40.126 lat (msec): min=1093, max=5424, avg=3273.86, stdev=1656.75 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 1083], 5.00th=[ 1116], 10.00th=[ 1167], 20.00th=[ 1284], 00:26:40.126 | 30.00th=[ 1334], 40.00th=[ 3037], 50.00th=[ 3339], 60.00th=[ 4463], 00:26:40.126 | 70.00th=[ 4665], 80.00th=[ 4933], 90.00th=[ 5067], 95.00th=[ 5269], 00:26:40.126 | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], 00:26:40.126 | 99.99th=[ 5403] 00:26:40.126 bw ( KiB/s): min= 8192, max=114688, per=1.74%, avg=59801.60, stdev=47401.36, samples=5 00:26:40.126 iops : min= 8, max= 112, avg=58.40, stdev=46.29, samples=5 00:26:40.126 lat (msec) : 250=0.36%, 2000=35.40%, >=2000=64.23% 00:26:40.126 cpu : usr=0.03%, sys=0.62%, ctx=1009, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.8%, 32=11.7%, >=64=77.0% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:26:40.126 issued rwts: total=274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429775: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=91, BW=91.7MiB/s (96.2MB/s)(972MiB/10595msec) 00:26:40.126 slat (usec): min=31, max=1965.9k, avg=10835.16, stdev=86076.07 00:26:40.126 clat (msec): min=60, max=3319, avg=1312.32, stdev=880.88 00:26:40.126 lat (msec): min=385, max=3325, avg=1323.16, stdev=882.59 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 435], 5.00th=[ 498], 10.00th=[ 558], 20.00th=[ 667], 00:26:40.126 | 30.00th=[ 751], 40.00th=[ 852], 50.00th=[ 978], 60.00th=[ 1028], 00:26:40.126 | 70.00th=[ 1150], 80.00th=[ 2198], 90.00th=[ 3071], 95.00th=[ 3239], 00:26:40.126 | 99.00th=[ 3272], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], 00:26:40.126 | 99.99th=[ 3306] 00:26:40.126 bw ( KiB/s): min=49152, max=286720, per=3.86%, avg=132888.77, stdev=60892.57, samples=13 00:26:40.126 iops : min= 48, max= 280, avg=129.62, stdev=59.39, samples=13 00:26:40.126 lat (msec) : 100=0.10%, 500=5.45%, 750=24.28%, 1000=26.54%, 2000=20.58% 00:26:40.126 lat (msec) : >=2000=23.05% 00:26:40.126 cpu : usr=0.04%, sys=1.09%, ctx=1922, majf=0, minf=32769 00:26:40.126 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.3%, >=64=93.5% 00:26:40.126 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.126 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.126 issued rwts: total=972,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.126 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.126 job5: (groupid=0, jobs=1): err= 0: pid=429776: Fri Apr 26 01:00:45 2024 00:26:40.126 read: IOPS=97, BW=97.2MiB/s (102MB/s)(1028MiB/10574msec) 00:26:40.126 slat (usec): min=542, max=2028.2k, avg=10180.75, stdev=89493.79 00:26:40.126 clat (msec): min=105, max=3473, avg=1142.75, stdev=1041.06 00:26:40.126 lat (msec): min=339, max=3477, avg=1152.93, stdev=1044.77 00:26:40.126 clat percentiles (msec): 00:26:40.126 | 1.00th=[ 338], 5.00th=[ 342], 10.00th=[ 347], 20.00th=[ 347], 00:26:40.126 | 30.00th=[ 351], 40.00th=[ 355], 50.00th=[ 363], 60.00th=[ 1334], 00:26:40.126 | 70.00th=[ 1519], 80.00th=[ 2366], 90.00th=[ 2735], 95.00th=[ 3138], 00:26:40.126 | 99.00th=[ 3406], 99.50th=[ 3440], 99.90th=[ 3473], 99.95th=[ 3473], 00:26:40.126 | 99.99th=[ 3473] 00:26:40.126 bw ( KiB/s): min=16384, max=378880, per=5.35%, avg=184320.00, stdev=144467.49, samples=10 00:26:40.126 iops : min= 16, max= 370, avg=180.00, stdev=141.08, samples=10 00:26:40.126 lat (msec) : 250=0.10%, 500=59.34%, 2000=12.26%, >=2000=28.31% 00:26:40.126 cpu : usr=0.01%, sys=1.07%, ctx=3136, majf=0, minf=32769 00:26:40.127 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.1%, >=64=93.9% 00:26:40.127 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.127 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.127 issued rwts: total=1028,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.127 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.127 job5: (groupid=0, jobs=1): err= 0: pid=429777: Fri Apr 26 01:00:45 2024 00:26:40.127 read: IOPS=74, BW=74.5MiB/s (78.2MB/s)(796MiB/10680msec) 00:26:40.127 slat (usec): min=961, max=2042.2k, avg=13279.14, stdev=139287.40 00:26:40.127 clat (msec): min=108, max=6626, avg=1010.92, stdev=1485.84 00:26:40.127 lat (msec): min=341, max=6630, avg=1024.20, stdev=1499.10 00:26:40.127 clat percentiles (msec): 00:26:40.127 | 1.00th=[ 338], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 347], 00:26:40.127 | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], 00:26:40.127 | 70.00th=[ 355], 80.00th=[ 2265], 90.00th=[ 2500], 95.00th=[ 4665], 00:26:40.127 | 99.00th=[ 6611], 99.50th=[ 6611], 99.90th=[ 6611], 99.95th=[ 6611], 00:26:40.127 | 99.99th=[ 6611] 00:26:40.127 bw ( KiB/s): min= 4096, max=376832, per=7.94%, avg=273612.80, stdev=154522.92, samples=5 00:26:40.127 iops : min= 4, max= 368, avg=267.20, stdev=150.90, samples=5 00:26:40.127 lat (msec) : 250=0.13%, 500=77.89%, >=2000=21.98% 00:26:40.127 cpu : usr=0.00%, sys=1.02%, ctx=2337, majf=0, minf=32769 00:26:40.127 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.1% 00:26:40.127 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.127 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.127 issued rwts: total=796,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.127 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.127 job5: (groupid=0, jobs=1): err= 0: pid=429778: Fri Apr 26 01:00:45 2024 00:26:40.127 read: IOPS=76, BW=76.6MiB/s (80.4MB/s)(807MiB/10531msec) 00:26:40.127 slat (usec): min=35, max=2058.6k, avg=12990.88, stdev=118548.76 00:26:40.127 clat (msec): min=45, max=3672, avg=1383.13, stdev=1147.31 00:26:40.127 lat (msec): min=333, max=3674, avg=1396.13, stdev=1148.70 00:26:40.127 clat percentiles (msec): 00:26:40.127 | 1.00th=[ 334], 5.00th=[ 347], 10.00th=[ 351], 20.00th=[ 368], 00:26:40.127 | 30.00th=[ 617], 40.00th=[ 625], 50.00th=[ 642], 60.00th=[ 651], 00:26:40.127 | 70.00th=[ 2366], 80.00th=[ 2601], 90.00th=[ 3473], 95.00th=[ 3574], 00:26:40.127 | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3675], 99.95th=[ 3675], 00:26:40.127 | 99.99th=[ 3675] 00:26:40.127 bw ( KiB/s): min= 8192, max=360448, per=4.04%, avg=139059.20, stdev=112221.14, samples=10 00:26:40.127 iops : min= 8, max= 352, avg=135.80, stdev=109.59, samples=10 00:26:40.127 lat (msec) : 50=0.12%, 500=22.06%, 750=39.28%, 2000=6.32%, >=2000=32.22% 00:26:40.127 cpu : usr=0.02%, sys=0.96%, ctx=814, majf=0, minf=32769 00:26:40.127 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.2% 00:26:40.127 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.127 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.127 issued rwts: total=807,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.127 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.127 job5: (groupid=0, jobs=1): err= 0: pid=429779: Fri Apr 26 01:00:45 2024 00:26:40.127 read: IOPS=129, BW=129MiB/s (136MB/s)(1295MiB/10016msec) 00:26:40.127 slat (usec): min=30, max=2012.0k, avg=7720.55, stdev=74948.55 00:26:40.127 clat (msec): min=13, max=2978, avg=921.66, stdev=868.16 00:26:40.127 lat (msec): min=17, max=2984, avg=929.38, stdev=870.85 00:26:40.127 clat percentiles (msec): 00:26:40.127 | 1.00th=[ 39], 5.00th=[ 180], 10.00th=[ 359], 20.00th=[ 422], 00:26:40.127 | 30.00th=[ 460], 40.00th=[ 477], 50.00th=[ 493], 60.00th=[ 550], 00:26:40.127 | 70.00th=[ 751], 80.00th=[ 1053], 90.00th=[ 2534], 95.00th=[ 2937], 00:26:40.127 | 99.00th=[ 2937], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], 00:26:40.127 | 99.99th=[ 2970] 00:26:40.127 bw ( KiB/s): min= 8192, max=364544, per=5.79%, avg=199338.67, stdev=96076.91, samples=12 00:26:40.127 iops : min= 8, max= 356, avg=194.67, stdev=93.83, samples=12 00:26:40.127 lat (msec) : 20=0.23%, 50=1.31%, 100=1.54%, 250=3.71%, 500=45.64% 00:26:40.127 lat (msec) : 750=17.76%, 1000=9.27%, 2000=0.93%, >=2000=19.61% 00:26:40.127 cpu : usr=0.00%, sys=1.23%, ctx=1531, majf=0, minf=32769 00:26:40.127 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.5%, >=64=95.1% 00:26:40.127 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.127 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.127 issued rwts: total=1295,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.127 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.127 job5: (groupid=0, jobs=1): err= 0: pid=429780: Fri Apr 26 01:00:45 2024 00:26:40.127 read: IOPS=120, BW=121MiB/s (126MB/s)(1288MiB/10677msec) 00:26:40.127 slat (usec): min=51, max=2015.5k, avg=8200.25, stdev=56550.44 00:26:40.127 clat (msec): min=111, max=2475, avg=1009.75, stdev=616.22 00:26:40.127 lat (msec): min=243, max=2476, avg=1017.95, stdev=617.38 00:26:40.127 clat percentiles (msec): 00:26:40.127 | 1.00th=[ 245], 5.00th=[ 247], 10.00th=[ 249], 20.00th=[ 384], 00:26:40.127 | 30.00th=[ 477], 40.00th=[ 793], 50.00th=[ 1020], 60.00th=[ 1099], 00:26:40.127 | 70.00th=[ 1250], 80.00th=[ 1435], 90.00th=[ 1737], 95.00th=[ 2366], 00:26:40.127 | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], 00:26:40.127 | 99.99th=[ 2467] 00:26:40.127 bw ( KiB/s): min= 4096, max=456704, per=4.31%, avg=148480.00, stdev=113331.71, samples=16 00:26:40.127 iops : min= 4, max= 446, avg=145.00, stdev=110.68, samples=16 00:26:40.127 lat (msec) : 250=10.33%, 500=20.19%, 750=8.15%, 1000=11.02%, 2000=40.45% 00:26:40.127 lat (msec) : >=2000=9.86% 00:26:40.127 cpu : usr=0.01%, sys=1.48%, ctx=2929, majf=0, minf=32769 00:26:40.127 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.2%, 32=2.5%, >=64=95.1% 00:26:40.127 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:40.127 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:40.127 issued rwts: total=1288,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:40.127 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:40.127 00:26:40.127 Run status group 0 (all jobs): 00:26:40.127 READ: bw=3364MiB/s (3527MB/s), 2516KiB/s-322MiB/s (2576kB/s-338MB/s), io=41.9GiB (45.0GB), run=10010-12748msec 00:26:40.127 00:26:40.127 Disk stats (read/write): 00:26:40.127 nvme0n1: ios=36449/0, merge=0/0, ticks=7371676/0, in_queue=7371676, util=98.67% 00:26:40.127 nvme1n1: ios=54359/0, merge=0/0, ticks=7823572/0, in_queue=7823572, util=98.79% 00:26:40.127 nvme2n1: ios=37159/0, merge=0/0, ticks=8078589/0, in_queue=8078589, util=98.96% 00:26:40.127 nvme3n1: ios=54216/0, merge=0/0, ticks=8003895/0, in_queue=8003895, util=99.05% 00:26:40.127 nvme4n1: ios=46442/0, merge=0/0, ticks=7638566/0, in_queue=7638566, util=98.91% 00:26:40.127 nvme5n1: ios=113263/0, merge=0/0, ticks=7207343/0, in_queue=7207343, util=99.23% 00:26:40.127 01:00:45 -- target/srq_overwhelm.sh@38 -- # sync 00:26:40.127 01:00:45 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:26:40.127 01:00:45 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:40.127 01:00:45 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:26:40.127 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:26:40.127 01:00:46 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:26:40.127 01:00:46 -- common/autotest_common.sh@1205 -- # local i=0 00:26:40.127 01:00:46 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:40.127 01:00:46 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000000 00:26:40.127 01:00:46 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000000 00:26:40.127 01:00:46 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:40.127 01:00:46 -- common/autotest_common.sh@1217 -- # return 0 00:26:40.127 01:00:46 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:26:40.127 01:00:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:40.127 01:00:46 -- common/autotest_common.sh@10 -- # set +x 00:26:40.127 01:00:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:40.127 01:00:46 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:40.127 01:00:46 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:26:40.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:26:40.389 01:00:47 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:26:40.389 01:00:47 -- common/autotest_common.sh@1205 -- # local i=0 00:26:40.389 01:00:47 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:40.389 01:00:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000001 00:26:40.389 01:00:47 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:40.389 01:00:47 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000001 00:26:40.389 01:00:47 -- common/autotest_common.sh@1217 -- # return 0 00:26:40.389 01:00:47 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:40.389 01:00:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:40.389 01:00:47 -- common/autotest_common.sh@10 -- # set +x 00:26:40.389 01:00:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:40.389 01:00:47 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:40.389 01:00:47 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:26:41.342 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:26:41.342 01:00:48 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:26:41.342 01:00:48 -- common/autotest_common.sh@1205 -- # local i=0 00:26:41.342 01:00:48 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:41.342 01:00:48 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000002 00:26:41.600 01:00:48 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:41.600 01:00:48 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000002 00:26:41.600 01:00:48 -- common/autotest_common.sh@1217 -- # return 0 00:26:41.600 01:00:48 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:26:41.600 01:00:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:41.600 01:00:48 -- common/autotest_common.sh@10 -- # set +x 00:26:41.600 01:00:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:41.600 01:00:48 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:41.600 01:00:48 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:26:42.537 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:26:42.537 01:00:49 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:26:42.537 01:00:49 -- common/autotest_common.sh@1205 -- # local i=0 00:26:42.537 01:00:49 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:42.537 01:00:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000003 00:26:42.537 01:00:49 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:42.537 01:00:49 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000003 00:26:42.537 01:00:49 -- common/autotest_common.sh@1217 -- # return 0 00:26:42.537 01:00:49 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:26:42.537 01:00:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:42.537 01:00:49 -- common/autotest_common.sh@10 -- # set +x 00:26:42.537 01:00:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:42.537 01:00:49 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:42.537 01:00:49 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:26:43.474 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:26:43.474 01:00:50 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:26:43.474 01:00:50 -- common/autotest_common.sh@1205 -- # local i=0 00:26:43.474 01:00:50 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:43.474 01:00:50 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000004 00:26:43.474 01:00:50 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:43.474 01:00:50 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000004 00:26:43.474 01:00:50 -- common/autotest_common.sh@1217 -- # return 0 00:26:43.474 01:00:50 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:26:43.474 01:00:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:43.474 01:00:50 -- common/autotest_common.sh@10 -- # set +x 00:26:43.474 01:00:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:43.474 01:00:50 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:26:43.474 01:00:50 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:26:44.410 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:26:44.410 01:00:51 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:26:44.410 01:00:51 -- common/autotest_common.sh@1205 -- # local i=0 00:26:44.410 01:00:51 -- common/autotest_common.sh@1206 -- # lsblk -o NAME,SERIAL 00:26:44.410 01:00:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK00000000000005 00:26:44.410 01:00:51 -- common/autotest_common.sh@1213 -- # lsblk -l -o NAME,SERIAL 00:26:44.410 01:00:51 -- common/autotest_common.sh@1213 -- # grep -q -w SPDK00000000000005 00:26:44.410 01:00:51 -- common/autotest_common.sh@1217 -- # return 0 00:26:44.410 01:00:51 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:26:44.410 01:00:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:44.410 01:00:51 -- common/autotest_common.sh@10 -- # set +x 00:26:44.410 01:00:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:44.410 01:00:51 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:26:44.410 01:00:51 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:26:44.410 01:00:51 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:44.410 01:00:51 -- nvmf/common.sh@117 -- # sync 00:26:44.410 01:00:51 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:44.410 01:00:51 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:44.410 01:00:51 -- nvmf/common.sh@120 -- # set +e 00:26:44.410 01:00:51 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:44.410 01:00:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:44.410 rmmod nvme_rdma 00:26:44.410 rmmod nvme_fabrics 00:26:44.410 01:00:51 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:44.410 01:00:51 -- nvmf/common.sh@124 -- # set -e 00:26:44.410 01:00:51 -- nvmf/common.sh@125 -- # return 0 00:26:44.410 01:00:51 -- nvmf/common.sh@478 -- # '[' -n 428098 ']' 00:26:44.410 01:00:51 -- nvmf/common.sh@479 -- # killprocess 428098 00:26:44.410 01:00:51 -- common/autotest_common.sh@936 -- # '[' -z 428098 ']' 00:26:44.410 01:00:51 -- common/autotest_common.sh@940 -- # kill -0 428098 00:26:44.410 01:00:51 -- common/autotest_common.sh@941 -- # uname 00:26:44.410 01:00:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:44.410 01:00:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 428098 00:26:44.410 01:00:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:44.410 01:00:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:44.410 01:00:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 428098' 00:26:44.410 killing process with pid 428098 00:26:44.410 01:00:51 -- common/autotest_common.sh@955 -- # kill 428098 00:26:44.410 01:00:51 -- common/autotest_common.sh@960 -- # wait 428098 00:26:44.669 [2024-04-26 01:00:51.618190] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:44.929 01:00:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:44.929 01:00:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:44.929 00:26:44.929 real 0m32.645s 00:26:44.929 user 1m55.756s 00:26:44.929 sys 0m13.259s 00:26:44.929 01:00:51 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:44.929 01:00:51 -- common/autotest_common.sh@10 -- # set +x 00:26:44.929 ************************************ 00:26:44.929 END TEST nvmf_srq_overwhelm 00:26:44.929 ************************************ 00:26:44.929 01:00:51 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:44.929 01:00:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:44.929 01:00:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:44.929 01:00:51 -- common/autotest_common.sh@10 -- # set +x 00:26:44.929 ************************************ 00:26:44.929 START TEST nvmf_shutdown 00:26:44.929 ************************************ 00:26:44.929 01:00:52 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:26:45.189 * Looking for test storage... 00:26:45.189 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:26:45.189 01:00:52 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:26:45.189 01:00:52 -- nvmf/common.sh@7 -- # uname -s 00:26:45.189 01:00:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:45.189 01:00:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:45.189 01:00:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:45.189 01:00:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:45.189 01:00:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:45.189 01:00:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:45.189 01:00:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:45.189 01:00:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:45.189 01:00:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:45.189 01:00:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:45.189 01:00:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:26:45.189 01:00:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:26:45.189 01:00:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:45.189 01:00:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:45.189 01:00:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:45.189 01:00:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:26:45.189 01:00:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:26:45.189 01:00:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:45.189 01:00:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:45.189 01:00:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:45.189 01:00:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.189 01:00:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.189 01:00:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.189 01:00:52 -- paths/export.sh@5 -- # export PATH 00:26:45.189 01:00:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.189 01:00:52 -- nvmf/common.sh@47 -- # : 0 00:26:45.189 01:00:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:26:45.189 01:00:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:26:45.189 01:00:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:26:45.189 01:00:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:45.189 01:00:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:45.189 01:00:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:26:45.189 01:00:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:26:45.189 01:00:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:26:45.189 01:00:52 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:45.189 01:00:52 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:45.189 01:00:52 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:26:45.189 01:00:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:45.189 01:00:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:45.189 01:00:52 -- common/autotest_common.sh@10 -- # set +x 00:26:45.189 ************************************ 00:26:45.189 START TEST nvmf_shutdown_tc1 00:26:45.189 ************************************ 00:26:45.189 01:00:52 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc1 00:26:45.189 01:00:52 -- target/shutdown.sh@74 -- # starttarget 00:26:45.189 01:00:52 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:45.189 01:00:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:45.189 01:00:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:45.189 01:00:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:45.189 01:00:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:45.189 01:00:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:45.189 01:00:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:45.189 01:00:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:45.189 01:00:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:45.189 01:00:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:45.189 01:00:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:45.189 01:00:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:45.189 01:00:52 -- common/autotest_common.sh@10 -- # set +x 00:26:50.464 01:00:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:50.464 01:00:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:50.464 01:00:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:50.464 01:00:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:50.464 01:00:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:50.464 01:00:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:50.464 01:00:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:50.464 01:00:57 -- nvmf/common.sh@295 -- # net_devs=() 00:26:50.464 01:00:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:50.464 01:00:57 -- nvmf/common.sh@296 -- # e810=() 00:26:50.464 01:00:57 -- nvmf/common.sh@296 -- # local -ga e810 00:26:50.464 01:00:57 -- nvmf/common.sh@297 -- # x722=() 00:26:50.464 01:00:57 -- nvmf/common.sh@297 -- # local -ga x722 00:26:50.464 01:00:57 -- nvmf/common.sh@298 -- # mlx=() 00:26:50.464 01:00:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:50.464 01:00:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:50.464 01:00:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:50.464 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:50.464 01:00:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:50.464 01:00:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:50.464 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:50.464 01:00:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:50.464 01:00:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.464 01:00:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.464 01:00:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:50.464 Found net devices under 0000:18:00.0: mlx_0_0 00:26:50.464 01:00:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:50.464 01:00:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:50.464 01:00:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:50.464 Found net devices under 0000:18:00.1: mlx_0_1 00:26:50.464 01:00:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:50.464 01:00:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:50.464 01:00:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:50.464 01:00:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:50.464 01:00:57 -- nvmf/common.sh@58 -- # uname 00:26:50.464 01:00:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:50.464 01:00:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:50.464 01:00:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:50.464 01:00:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:50.464 01:00:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:50.464 01:00:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:50.464 01:00:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:50.464 01:00:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:50.464 01:00:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:50.464 01:00:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:50.464 01:00:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:50.464 01:00:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:50.464 01:00:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:50.464 01:00:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:50.464 01:00:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:50.464 01:00:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:50.464 01:00:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:50.464 01:00:57 -- nvmf/common.sh@105 -- # continue 2 00:26:50.464 01:00:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.464 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:50.464 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@105 -- # continue 2 00:26:50.465 01:00:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:50.465 01:00:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:50.465 01:00:57 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:50.465 01:00:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:50.465 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:50.465 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:50.465 altname enp24s0f0np0 00:26:50.465 altname ens785f0np0 00:26:50.465 inet 192.168.100.8/24 scope global mlx_0_0 00:26:50.465 valid_lft forever preferred_lft forever 00:26:50.465 01:00:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:50.465 01:00:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:50.465 01:00:57 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:50.465 01:00:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:50.465 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:50.465 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:50.465 altname enp24s0f1np1 00:26:50.465 altname ens785f1np1 00:26:50.465 inet 192.168.100.9/24 scope global mlx_0_1 00:26:50.465 valid_lft forever preferred_lft forever 00:26:50.465 01:00:57 -- nvmf/common.sh@411 -- # return 0 00:26:50.465 01:00:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:50.465 01:00:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:50.465 01:00:57 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:50.465 01:00:57 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:50.465 01:00:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:50.465 01:00:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:50.465 01:00:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:50.465 01:00:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:50.465 01:00:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:50.465 01:00:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@105 -- # continue 2 00:26:50.465 01:00:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:50.465 01:00:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:50.465 01:00:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@105 -- # continue 2 00:26:50.465 01:00:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:50.465 01:00:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:50.465 01:00:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:50.465 01:00:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:50.465 01:00:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:50.465 01:00:57 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:50.465 192.168.100.9' 00:26:50.465 01:00:57 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:50.465 192.168.100.9' 00:26:50.465 01:00:57 -- nvmf/common.sh@446 -- # head -n 1 00:26:50.465 01:00:57 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:50.465 01:00:57 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:50.465 192.168.100.9' 00:26:50.465 01:00:57 -- nvmf/common.sh@447 -- # tail -n +2 00:26:50.465 01:00:57 -- nvmf/common.sh@447 -- # head -n 1 00:26:50.465 01:00:57 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:50.465 01:00:57 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:50.465 01:00:57 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:50.465 01:00:57 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:50.465 01:00:57 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:50.465 01:00:57 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:50.723 01:00:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:50.723 01:00:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:50.723 01:00:57 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:50.723 01:00:57 -- common/autotest_common.sh@10 -- # set +x 00:26:50.723 01:00:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:50.723 01:00:57 -- nvmf/common.sh@470 -- # nvmfpid=436341 00:26:50.723 01:00:57 -- nvmf/common.sh@471 -- # waitforlisten 436341 00:26:50.723 01:00:57 -- common/autotest_common.sh@817 -- # '[' -z 436341 ']' 00:26:50.723 01:00:57 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:50.723 01:00:57 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:50.723 01:00:57 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:50.723 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:50.723 01:00:57 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:50.723 01:00:57 -- common/autotest_common.sh@10 -- # set +x 00:26:50.723 [2024-04-26 01:00:57.718933] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:50.723 [2024-04-26 01:00:57.718980] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:50.723 EAL: No free 2048 kB hugepages reported on node 1 00:26:50.723 [2024-04-26 01:00:57.771714] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:50.723 [2024-04-26 01:00:57.841370] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:50.723 [2024-04-26 01:00:57.841411] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:50.723 [2024-04-26 01:00:57.841417] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:50.723 [2024-04-26 01:00:57.841422] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:50.724 [2024-04-26 01:00:57.841426] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:50.724 [2024-04-26 01:00:57.841528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:50.724 [2024-04-26 01:00:57.841634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:50.724 [2024-04-26 01:00:57.841744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:50.724 [2024-04-26 01:00:57.841745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:51.660 01:00:58 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:51.660 01:00:58 -- common/autotest_common.sh@850 -- # return 0 00:26:51.660 01:00:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:51.660 01:00:58 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:51.660 01:00:58 -- common/autotest_common.sh@10 -- # set +x 00:26:51.660 01:00:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:51.660 01:00:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:51.660 01:00:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:51.660 01:00:58 -- common/autotest_common.sh@10 -- # set +x 00:26:51.660 [2024-04-26 01:00:58.569394] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb41b70/0xb46060) succeed. 00:26:51.660 [2024-04-26 01:00:58.578732] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb431b0/0xb876f0) succeed. 00:26:51.660 01:00:58 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:51.660 01:00:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:51.660 01:00:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:51.660 01:00:58 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:51.660 01:00:58 -- common/autotest_common.sh@10 -- # set +x 00:26:51.660 01:00:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:51.660 01:00:58 -- target/shutdown.sh@28 -- # cat 00:26:51.660 01:00:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:51.660 01:00:58 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:51.660 01:00:58 -- common/autotest_common.sh@10 -- # set +x 00:26:51.660 Malloc1 00:26:51.660 [2024-04-26 01:00:58.785804] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:51.660 Malloc2 00:26:51.660 Malloc3 00:26:51.920 Malloc4 00:26:51.920 Malloc5 00:26:51.920 Malloc6 00:26:51.920 Malloc7 00:26:51.920 Malloc8 00:26:52.180 Malloc9 00:26:52.180 Malloc10 00:26:52.180 01:00:59 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:52.180 01:00:59 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:52.180 01:00:59 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:52.180 01:00:59 -- common/autotest_common.sh@10 -- # set +x 00:26:52.180 01:00:59 -- target/shutdown.sh@78 -- # perfpid=436656 00:26:52.180 01:00:59 -- target/shutdown.sh@79 -- # waitforlisten 436656 /var/tmp/bdevperf.sock 00:26:52.180 01:00:59 -- common/autotest_common.sh@817 -- # '[' -z 436656 ']' 00:26:52.180 01:00:59 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:52.180 01:00:59 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:26:52.180 01:00:59 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:52.180 01:00:59 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:52.180 01:00:59 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:52.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:52.180 01:00:59 -- nvmf/common.sh@521 -- # config=() 00:26:52.180 01:00:59 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:52.180 01:00:59 -- nvmf/common.sh@521 -- # local subsystem config 00:26:52.180 01:00:59 -- common/autotest_common.sh@10 -- # set +x 00:26:52.180 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.180 { 00:26:52.180 "params": { 00:26:52.180 "name": "Nvme$subsystem", 00:26:52.180 "trtype": "$TEST_TRANSPORT", 00:26:52.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.180 "adrfam": "ipv4", 00:26:52.180 "trsvcid": "$NVMF_PORT", 00:26:52.180 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.180 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.180 "hdgst": ${hdgst:-false}, 00:26:52.180 "ddgst": ${ddgst:-false} 00:26:52.180 }, 00:26:52.180 "method": "bdev_nvme_attach_controller" 00:26:52.180 } 00:26:52.180 EOF 00:26:52.180 )") 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.180 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.180 { 00:26:52.180 "params": { 00:26:52.180 "name": "Nvme$subsystem", 00:26:52.180 "trtype": "$TEST_TRANSPORT", 00:26:52.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.180 "adrfam": "ipv4", 00:26:52.180 "trsvcid": "$NVMF_PORT", 00:26:52.180 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.180 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.180 "hdgst": ${hdgst:-false}, 00:26:52.180 "ddgst": ${ddgst:-false} 00:26:52.180 }, 00:26:52.180 "method": "bdev_nvme_attach_controller" 00:26:52.180 } 00:26:52.180 EOF 00:26:52.180 )") 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.180 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.180 { 00:26:52.180 "params": { 00:26:52.180 "name": "Nvme$subsystem", 00:26:52.180 "trtype": "$TEST_TRANSPORT", 00:26:52.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.180 "adrfam": "ipv4", 00:26:52.180 "trsvcid": "$NVMF_PORT", 00:26:52.180 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.180 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.180 "hdgst": ${hdgst:-false}, 00:26:52.180 "ddgst": ${ddgst:-false} 00:26:52.180 }, 00:26:52.180 "method": "bdev_nvme_attach_controller" 00:26:52.180 } 00:26:52.180 EOF 00:26:52.180 )") 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.180 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.180 { 00:26:52.180 "params": { 00:26:52.180 "name": "Nvme$subsystem", 00:26:52.180 "trtype": "$TEST_TRANSPORT", 00:26:52.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.180 "adrfam": "ipv4", 00:26:52.180 "trsvcid": "$NVMF_PORT", 00:26:52.180 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.180 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.180 "hdgst": ${hdgst:-false}, 00:26:52.180 "ddgst": ${ddgst:-false} 00:26:52.180 }, 00:26:52.180 "method": "bdev_nvme_attach_controller" 00:26:52.180 } 00:26:52.180 EOF 00:26:52.180 )") 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.180 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.180 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.180 { 00:26:52.180 "params": { 00:26:52.180 "name": "Nvme$subsystem", 00:26:52.180 "trtype": "$TEST_TRANSPORT", 00:26:52.180 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.180 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.181 { 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme$subsystem", 00:26:52.181 "trtype": "$TEST_TRANSPORT", 00:26:52.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 [2024-04-26 01:00:59.258679] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:52.181 [2024-04-26 01:00:59.258724] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:26:52.181 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.181 { 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme$subsystem", 00:26:52.181 "trtype": "$TEST_TRANSPORT", 00:26:52.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.181 { 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme$subsystem", 00:26:52.181 "trtype": "$TEST_TRANSPORT", 00:26:52.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.181 { 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme$subsystem", 00:26:52.181 "trtype": "$TEST_TRANSPORT", 00:26:52.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 01:00:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:52.181 { 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme$subsystem", 00:26:52.181 "trtype": "$TEST_TRANSPORT", 00:26:52.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "$NVMF_PORT", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:52.181 "hdgst": ${hdgst:-false}, 00:26:52.181 "ddgst": ${ddgst:-false} 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 } 00:26:52.181 EOF 00:26:52.181 )") 00:26:52.181 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.181 01:00:59 -- nvmf/common.sh@543 -- # cat 00:26:52.181 01:00:59 -- nvmf/common.sh@545 -- # jq . 00:26:52.181 01:00:59 -- nvmf/common.sh@546 -- # IFS=, 00:26:52.181 01:00:59 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme1", 00:26:52.181 "trtype": "rdma", 00:26:52.181 "traddr": "192.168.100.8", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "4420", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:52.181 "hdgst": false, 00:26:52.181 "ddgst": false 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 },{ 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme2", 00:26:52.181 "trtype": "rdma", 00:26:52.181 "traddr": "192.168.100.8", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "4420", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:52.181 "hdgst": false, 00:26:52.181 "ddgst": false 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 },{ 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme3", 00:26:52.181 "trtype": "rdma", 00:26:52.181 "traddr": "192.168.100.8", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "4420", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:52.181 "hdgst": false, 00:26:52.181 "ddgst": false 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 },{ 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme4", 00:26:52.181 "trtype": "rdma", 00:26:52.181 "traddr": "192.168.100.8", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "4420", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:52.181 "hdgst": false, 00:26:52.181 "ddgst": false 00:26:52.181 }, 00:26:52.181 "method": "bdev_nvme_attach_controller" 00:26:52.181 },{ 00:26:52.181 "params": { 00:26:52.181 "name": "Nvme5", 00:26:52.181 "trtype": "rdma", 00:26:52.181 "traddr": "192.168.100.8", 00:26:52.181 "adrfam": "ipv4", 00:26:52.181 "trsvcid": "4420", 00:26:52.181 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:52.181 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 },{ 00:26:52.182 "params": { 00:26:52.182 "name": "Nvme6", 00:26:52.182 "trtype": "rdma", 00:26:52.182 "traddr": "192.168.100.8", 00:26:52.182 "adrfam": "ipv4", 00:26:52.182 "trsvcid": "4420", 00:26:52.182 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:52.182 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 },{ 00:26:52.182 "params": { 00:26:52.182 "name": "Nvme7", 00:26:52.182 "trtype": "rdma", 00:26:52.182 "traddr": "192.168.100.8", 00:26:52.182 "adrfam": "ipv4", 00:26:52.182 "trsvcid": "4420", 00:26:52.182 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:52.182 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 },{ 00:26:52.182 "params": { 00:26:52.182 "name": "Nvme8", 00:26:52.182 "trtype": "rdma", 00:26:52.182 "traddr": "192.168.100.8", 00:26:52.182 "adrfam": "ipv4", 00:26:52.182 "trsvcid": "4420", 00:26:52.182 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:52.182 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 },{ 00:26:52.182 "params": { 00:26:52.182 "name": "Nvme9", 00:26:52.182 "trtype": "rdma", 00:26:52.182 "traddr": "192.168.100.8", 00:26:52.182 "adrfam": "ipv4", 00:26:52.182 "trsvcid": "4420", 00:26:52.182 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:52.182 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 },{ 00:26:52.182 "params": { 00:26:52.182 "name": "Nvme10", 00:26:52.182 "trtype": "rdma", 00:26:52.182 "traddr": "192.168.100.8", 00:26:52.182 "adrfam": "ipv4", 00:26:52.182 "trsvcid": "4420", 00:26:52.182 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:52.182 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:52.182 "hdgst": false, 00:26:52.182 "ddgst": false 00:26:52.182 }, 00:26:52.182 "method": "bdev_nvme_attach_controller" 00:26:52.182 }' 00:26:52.182 [2024-04-26 01:00:59.309808] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:52.442 [2024-04-26 01:00:59.375769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:53.379 01:01:00 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:53.379 01:01:00 -- common/autotest_common.sh@850 -- # return 0 00:26:53.379 01:01:00 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:26:53.379 01:01:00 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:53.379 01:01:00 -- common/autotest_common.sh@10 -- # set +x 00:26:53.379 01:01:00 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:53.379 01:01:00 -- target/shutdown.sh@83 -- # kill -9 436656 00:26:53.379 01:01:00 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:26:53.379 01:01:00 -- target/shutdown.sh@87 -- # sleep 1 00:26:54.318 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 436656 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:26:54.318 01:01:01 -- target/shutdown.sh@88 -- # kill -0 436341 00:26:54.318 01:01:01 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:26:54.318 01:01:01 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:54.318 01:01:01 -- nvmf/common.sh@521 -- # config=() 00:26:54.318 01:01:01 -- nvmf/common.sh@521 -- # local subsystem config 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 [2024-04-26 01:01:01.276001] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:54.318 [2024-04-26 01:01:01.276050] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid437116 ] 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 01:01:01 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:54.318 { 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme$subsystem", 00:26:54.318 "trtype": "$TEST_TRANSPORT", 00:26:54.318 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:54.318 "adrfam": "ipv4", 00:26:54.318 "trsvcid": "$NVMF_PORT", 00:26:54.318 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:54.318 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:54.318 "hdgst": ${hdgst:-false}, 00:26:54.318 "ddgst": ${ddgst:-false} 00:26:54.318 }, 00:26:54.318 "method": "bdev_nvme_attach_controller" 00:26:54.318 } 00:26:54.318 EOF 00:26:54.318 )") 00:26:54.318 01:01:01 -- nvmf/common.sh@543 -- # cat 00:26:54.318 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.318 01:01:01 -- nvmf/common.sh@545 -- # jq . 00:26:54.318 01:01:01 -- nvmf/common.sh@546 -- # IFS=, 00:26:54.318 01:01:01 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:54.318 "params": { 00:26:54.318 "name": "Nvme1", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme2", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme3", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme4", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme5", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme6", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme7", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme8", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme9", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 },{ 00:26:54.319 "params": { 00:26:54.319 "name": "Nvme10", 00:26:54.319 "trtype": "rdma", 00:26:54.319 "traddr": "192.168.100.8", 00:26:54.319 "adrfam": "ipv4", 00:26:54.319 "trsvcid": "4420", 00:26:54.319 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:54.319 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:54.319 "hdgst": false, 00:26:54.319 "ddgst": false 00:26:54.319 }, 00:26:54.319 "method": "bdev_nvme_attach_controller" 00:26:54.319 }' 00:26:54.319 [2024-04-26 01:01:01.329181] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:54.319 [2024-04-26 01:01:01.395999] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:55.257 Running I/O for 1 seconds... 00:26:56.634 00:26:56.634 Latency(us) 00:26:56.634 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.634 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme1n1 : 1.15 401.82 25.11 0.00 0.00 153923.18 6505.05 200394.52 00:26:56.634 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme2n1 : 1.16 401.53 25.10 0.00 0.00 149247.25 6941.96 149130.81 00:26:56.634 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme3n1 : 1.16 403.83 25.24 0.00 0.00 146507.89 4611.79 139810.13 00:26:56.634 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme4n1 : 1.16 400.94 25.06 0.00 0.00 145667.15 13981.01 129712.73 00:26:56.634 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme5n1 : 1.16 392.07 24.50 0.00 0.00 145614.81 17864.63 117285.17 00:26:56.634 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme6n1 : 1.16 440.26 27.52 0.00 0.00 134927.45 3422.44 107187.77 00:26:56.634 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme7n1 : 1.16 439.82 27.49 0.00 0.00 133211.02 3859.34 99420.54 00:26:56.634 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme8n1 : 1.17 439.39 27.46 0.00 0.00 131554.94 4247.70 91653.31 00:26:56.634 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme9n1 : 1.17 438.82 27.43 0.00 0.00 130170.79 4975.88 98643.82 00:26:56.634 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:26:56.634 Verification LBA range: start 0x0 length 0x400 00:26:56.634 Nvme10n1 : 1.17 328.71 20.54 0.00 0.00 171360.77 5849.69 341758.10 00:26:56.634 =================================================================================================================== 00:26:56.634 Total : 4087.20 255.45 0.00 0.00 143283.87 3422.44 341758.10 00:26:56.634 01:01:03 -- target/shutdown.sh@94 -- # stoptarget 00:26:56.634 01:01:03 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:26:56.634 01:01:03 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:26:56.634 01:01:03 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:56.634 01:01:03 -- target/shutdown.sh@45 -- # nvmftestfini 00:26:56.634 01:01:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:26:56.634 01:01:03 -- nvmf/common.sh@117 -- # sync 00:26:56.634 01:01:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:26:56.634 01:01:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:26:56.634 01:01:03 -- nvmf/common.sh@120 -- # set +e 00:26:56.635 01:01:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:26:56.635 01:01:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:26:56.635 rmmod nvme_rdma 00:26:56.635 rmmod nvme_fabrics 00:26:56.635 01:01:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:26:56.635 01:01:03 -- nvmf/common.sh@124 -- # set -e 00:26:56.635 01:01:03 -- nvmf/common.sh@125 -- # return 0 00:26:56.635 01:01:03 -- nvmf/common.sh@478 -- # '[' -n 436341 ']' 00:26:56.635 01:01:03 -- nvmf/common.sh@479 -- # killprocess 436341 00:26:56.635 01:01:03 -- common/autotest_common.sh@936 -- # '[' -z 436341 ']' 00:26:56.635 01:01:03 -- common/autotest_common.sh@940 -- # kill -0 436341 00:26:56.635 01:01:03 -- common/autotest_common.sh@941 -- # uname 00:26:56.635 01:01:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.635 01:01:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 436341 00:26:56.635 01:01:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.635 01:01:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.635 01:01:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 436341' 00:26:56.635 killing process with pid 436341 00:26:56.635 01:01:03 -- common/autotest_common.sh@955 -- # kill 436341 00:26:56.635 01:01:03 -- common/autotest_common.sh@960 -- # wait 436341 00:26:56.894 [2024-04-26 01:01:03.876443] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:26:57.153 01:01:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:26:57.153 01:01:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:26:57.153 00:26:57.153 real 0m11.960s 00:26:57.153 user 0m29.943s 00:26:57.153 sys 0m4.955s 00:26:57.153 01:01:04 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:26:57.153 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:26:57.153 ************************************ 00:26:57.153 END TEST nvmf_shutdown_tc1 00:26:57.153 ************************************ 00:26:57.153 01:01:04 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:26:57.153 01:01:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:57.153 01:01:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:57.153 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:26:57.414 ************************************ 00:26:57.414 START TEST nvmf_shutdown_tc2 00:26:57.414 ************************************ 00:26:57.414 01:01:04 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc2 00:26:57.414 01:01:04 -- target/shutdown.sh@99 -- # starttarget 00:26:57.414 01:01:04 -- target/shutdown.sh@15 -- # nvmftestinit 00:26:57.414 01:01:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:26:57.414 01:01:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:57.414 01:01:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:26:57.414 01:01:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:26:57.414 01:01:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:26:57.414 01:01:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:57.414 01:01:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:57.414 01:01:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:57.414 01:01:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:26:57.414 01:01:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:26:57.414 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:26:57.414 01:01:04 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:57.414 01:01:04 -- nvmf/common.sh@291 -- # pci_devs=() 00:26:57.414 01:01:04 -- nvmf/common.sh@291 -- # local -a pci_devs 00:26:57.414 01:01:04 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:26:57.414 01:01:04 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:26:57.414 01:01:04 -- nvmf/common.sh@293 -- # pci_drivers=() 00:26:57.414 01:01:04 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:26:57.414 01:01:04 -- nvmf/common.sh@295 -- # net_devs=() 00:26:57.414 01:01:04 -- nvmf/common.sh@295 -- # local -ga net_devs 00:26:57.414 01:01:04 -- nvmf/common.sh@296 -- # e810=() 00:26:57.414 01:01:04 -- nvmf/common.sh@296 -- # local -ga e810 00:26:57.414 01:01:04 -- nvmf/common.sh@297 -- # x722=() 00:26:57.414 01:01:04 -- nvmf/common.sh@297 -- # local -ga x722 00:26:57.414 01:01:04 -- nvmf/common.sh@298 -- # mlx=() 00:26:57.414 01:01:04 -- nvmf/common.sh@298 -- # local -ga mlx 00:26:57.414 01:01:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:57.414 01:01:04 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:26:57.414 01:01:04 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:26:57.414 01:01:04 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:26:57.414 01:01:04 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:26:57.414 01:01:04 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:26:57.414 01:01:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:57.414 01:01:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:26:57.414 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:26:57.414 01:01:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:57.414 01:01:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:57.414 01:01:04 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:26:57.415 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:26:57.415 01:01:04 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:26:57.415 01:01:04 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.415 01:01:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.415 01:01:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:26:57.415 Found net devices under 0000:18:00.0: mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.415 01:01:04 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:57.415 01:01:04 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:57.415 01:01:04 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:26:57.415 Found net devices under 0000:18:00.1: mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:26:57.415 01:01:04 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@403 -- # is_hw=yes 00:26:57.415 01:01:04 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@409 -- # rdma_device_init 00:26:57.415 01:01:04 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:26:57.415 01:01:04 -- nvmf/common.sh@58 -- # uname 00:26:57.415 01:01:04 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:26:57.415 01:01:04 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:26:57.415 01:01:04 -- nvmf/common.sh@63 -- # modprobe ib_core 00:26:57.415 01:01:04 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:26:57.415 01:01:04 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:26:57.415 01:01:04 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:26:57.415 01:01:04 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:26:57.415 01:01:04 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:26:57.415 01:01:04 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:26:57.415 01:01:04 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:26:57.415 01:01:04 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:26:57.415 01:01:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:57.415 01:01:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:57.415 01:01:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:57.415 01:01:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:57.415 01:01:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@105 -- # continue 2 00:26:57.415 01:01:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@105 -- # continue 2 00:26:57.415 01:01:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:57.415 01:01:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:57.415 01:01:04 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:26:57.415 01:01:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:26:57.415 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:57.415 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:26:57.415 altname enp24s0f0np0 00:26:57.415 altname ens785f0np0 00:26:57.415 inet 192.168.100.8/24 scope global mlx_0_0 00:26:57.415 valid_lft forever preferred_lft forever 00:26:57.415 01:01:04 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:26:57.415 01:01:04 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:57.415 01:01:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:57.415 01:01:04 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:26:57.415 01:01:04 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:26:57.415 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:26:57.415 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:26:57.415 altname enp24s0f1np1 00:26:57.415 altname ens785f1np1 00:26:57.415 inet 192.168.100.9/24 scope global mlx_0_1 00:26:57.415 valid_lft forever preferred_lft forever 00:26:57.415 01:01:04 -- nvmf/common.sh@411 -- # return 0 00:26:57.415 01:01:04 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:26:57.415 01:01:04 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:26:57.415 01:01:04 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:26:57.415 01:01:04 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:26:57.415 01:01:04 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:26:57.415 01:01:04 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:26:57.415 01:01:04 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:26:57.415 01:01:04 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:26:57.415 01:01:04 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:26:57.415 01:01:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:26:57.415 01:01:04 -- nvmf/common.sh@105 -- # continue 2 00:26:57.415 01:01:04 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:26:57.415 01:01:04 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:26:57.415 01:01:04 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:26:57.415 01:01:04 -- nvmf/common.sh@105 -- # continue 2 00:26:57.676 01:01:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:57.676 01:01:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:26:57.676 01:01:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:57.676 01:01:04 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:26:57.676 01:01:04 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:26:57.676 01:01:04 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:26:57.676 01:01:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:26:57.676 01:01:04 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:26:57.676 192.168.100.9' 00:26:57.676 01:01:04 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:26:57.676 192.168.100.9' 00:26:57.676 01:01:04 -- nvmf/common.sh@446 -- # head -n 1 00:26:57.676 01:01:04 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:26:57.676 01:01:04 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:26:57.676 192.168.100.9' 00:26:57.676 01:01:04 -- nvmf/common.sh@447 -- # tail -n +2 00:26:57.676 01:01:04 -- nvmf/common.sh@447 -- # head -n 1 00:26:57.676 01:01:04 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:26:57.676 01:01:04 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:26:57.676 01:01:04 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:26:57.676 01:01:04 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:26:57.677 01:01:04 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:26:57.677 01:01:04 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:26:57.677 01:01:04 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:26:57.677 01:01:04 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:26:57.677 01:01:04 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:57.677 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:26:57.677 01:01:04 -- nvmf/common.sh@470 -- # nvmfpid=437834 00:26:57.677 01:01:04 -- nvmf/common.sh@471 -- # waitforlisten 437834 00:26:57.677 01:01:04 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:26:57.677 01:01:04 -- common/autotest_common.sh@817 -- # '[' -z 437834 ']' 00:26:57.677 01:01:04 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:57.677 01:01:04 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:57.677 01:01:04 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:57.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:57.677 01:01:04 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:57.677 01:01:04 -- common/autotest_common.sh@10 -- # set +x 00:26:57.677 [2024-04-26 01:01:04.717759] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:57.677 [2024-04-26 01:01:04.717806] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:57.677 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.677 [2024-04-26 01:01:04.770298] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:57.677 [2024-04-26 01:01:04.839226] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:57.677 [2024-04-26 01:01:04.839269] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:57.677 [2024-04-26 01:01:04.839275] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:26:57.677 [2024-04-26 01:01:04.839281] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:26:57.677 [2024-04-26 01:01:04.839285] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:57.677 [2024-04-26 01:01:04.839401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:57.677 [2024-04-26 01:01:04.839479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:57.677 [2024-04-26 01:01:04.839587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.677 [2024-04-26 01:01:04.839589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:26:58.615 01:01:05 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:26:58.615 01:01:05 -- common/autotest_common.sh@850 -- # return 0 00:26:58.615 01:01:05 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:26:58.615 01:01:05 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:58.615 01:01:05 -- common/autotest_common.sh@10 -- # set +x 00:26:58.615 01:01:05 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:58.615 01:01:05 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:26:58.615 01:01:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:58.615 01:01:05 -- common/autotest_common.sh@10 -- # set +x 00:26:58.615 [2024-04-26 01:01:05.555406] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xacdb70/0xad2060) succeed. 00:26:58.615 [2024-04-26 01:01:05.564571] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xacf1b0/0xb136f0) succeed. 00:26:58.615 01:01:05 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:58.615 01:01:05 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:26:58.615 01:01:05 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:26:58.615 01:01:05 -- common/autotest_common.sh@710 -- # xtrace_disable 00:26:58.615 01:01:05 -- common/autotest_common.sh@10 -- # set +x 00:26:58.615 01:01:05 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.615 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.615 01:01:05 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:26:58.616 01:01:05 -- target/shutdown.sh@28 -- # cat 00:26:58.616 01:01:05 -- target/shutdown.sh@35 -- # rpc_cmd 00:26:58.616 01:01:05 -- common/autotest_common.sh@549 -- # xtrace_disable 00:26:58.616 01:01:05 -- common/autotest_common.sh@10 -- # set +x 00:26:58.616 Malloc1 00:26:58.616 [2024-04-26 01:01:05.765883] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:26:58.616 Malloc2 00:26:58.874 Malloc3 00:26:58.874 Malloc4 00:26:58.874 Malloc5 00:26:58.874 Malloc6 00:26:58.874 Malloc7 00:26:58.874 Malloc8 00:26:59.133 Malloc9 00:26:59.133 Malloc10 00:26:59.133 01:01:06 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:26:59.133 01:01:06 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:26:59.133 01:01:06 -- common/autotest_common.sh@716 -- # xtrace_disable 00:26:59.133 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:26:59.133 01:01:06 -- target/shutdown.sh@103 -- # perfpid=438151 00:26:59.133 01:01:06 -- target/shutdown.sh@104 -- # waitforlisten 438151 /var/tmp/bdevperf.sock 00:26:59.133 01:01:06 -- common/autotest_common.sh@817 -- # '[' -z 438151 ']' 00:26:59.133 01:01:06 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:59.133 01:01:06 -- common/autotest_common.sh@822 -- # local max_retries=100 00:26:59.133 01:01:06 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:26:59.133 01:01:06 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:26:59.133 01:01:06 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:59.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:59.133 01:01:06 -- common/autotest_common.sh@826 -- # xtrace_disable 00:26:59.133 01:01:06 -- nvmf/common.sh@521 -- # config=() 00:26:59.133 01:01:06 -- common/autotest_common.sh@10 -- # set +x 00:26:59.133 01:01:06 -- nvmf/common.sh@521 -- # local subsystem config 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 [2024-04-26 01:01:06.231026] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:26:59.133 [2024-04-26 01:01:06.231068] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid438151 ] 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.133 "hdgst": ${hdgst:-false}, 00:26:59.133 "ddgst": ${ddgst:-false} 00:26:59.133 }, 00:26:59.133 "method": "bdev_nvme_attach_controller" 00:26:59.133 } 00:26:59.133 EOF 00:26:59.133 )") 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.133 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.133 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.133 { 00:26:59.133 "params": { 00:26:59.133 "name": "Nvme$subsystem", 00:26:59.133 "trtype": "$TEST_TRANSPORT", 00:26:59.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.133 "adrfam": "ipv4", 00:26:59.133 "trsvcid": "$NVMF_PORT", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.134 "hdgst": ${hdgst:-false}, 00:26:59.134 "ddgst": ${ddgst:-false} 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 } 00:26:59.134 EOF 00:26:59.134 )") 00:26:59.134 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.134 01:01:06 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:26:59.134 01:01:06 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:26:59.134 { 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme$subsystem", 00:26:59.134 "trtype": "$TEST_TRANSPORT", 00:26:59.134 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "$NVMF_PORT", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:59.134 "hdgst": ${hdgst:-false}, 00:26:59.134 "ddgst": ${ddgst:-false} 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 } 00:26:59.134 EOF 00:26:59.134 )") 00:26:59.134 01:01:06 -- nvmf/common.sh@543 -- # cat 00:26:59.134 EAL: No free 2048 kB hugepages reported on node 1 00:26:59.134 01:01:06 -- nvmf/common.sh@545 -- # jq . 00:26:59.134 01:01:06 -- nvmf/common.sh@546 -- # IFS=, 00:26:59.134 01:01:06 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme1", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme2", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme3", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme4", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme5", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme6", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme7", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme8", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme9", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 },{ 00:26:59.134 "params": { 00:26:59.134 "name": "Nvme10", 00:26:59.134 "trtype": "rdma", 00:26:59.134 "traddr": "192.168.100.8", 00:26:59.134 "adrfam": "ipv4", 00:26:59.134 "trsvcid": "4420", 00:26:59.134 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:26:59.134 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:26:59.134 "hdgst": false, 00:26:59.134 "ddgst": false 00:26:59.134 }, 00:26:59.134 "method": "bdev_nvme_attach_controller" 00:26:59.134 }' 00:26:59.134 [2024-04-26 01:01:06.282913] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:59.392 [2024-04-26 01:01:06.353332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:00.327 Running I/O for 10 seconds... 00:27:00.327 01:01:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:00.327 01:01:07 -- common/autotest_common.sh@850 -- # return 0 00:27:00.327 01:01:07 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:27:00.327 01:01:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.327 01:01:07 -- common/autotest_common.sh@10 -- # set +x 00:27:00.327 01:01:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.327 01:01:07 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:27:00.327 01:01:07 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:27:00.327 01:01:07 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:27:00.327 01:01:07 -- target/shutdown.sh@57 -- # local ret=1 00:27:00.327 01:01:07 -- target/shutdown.sh@58 -- # local i 00:27:00.327 01:01:07 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:27:00.327 01:01:07 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:27:00.327 01:01:07 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:27:00.327 01:01:07 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:27:00.327 01:01:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.327 01:01:07 -- common/autotest_common.sh@10 -- # set +x 00:27:00.327 01:01:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.327 01:01:07 -- target/shutdown.sh@60 -- # read_io_count=3 00:27:00.327 01:01:07 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:27:00.327 01:01:07 -- target/shutdown.sh@67 -- # sleep 0.25 00:27:00.585 01:01:07 -- target/shutdown.sh@59 -- # (( i-- )) 00:27:00.585 01:01:07 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:27:00.585 01:01:07 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:27:00.585 01:01:07 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:27:00.585 01:01:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:00.585 01:01:07 -- common/autotest_common.sh@10 -- # set +x 00:27:00.844 01:01:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:00.844 01:01:07 -- target/shutdown.sh@60 -- # read_io_count=155 00:27:00.844 01:01:07 -- target/shutdown.sh@63 -- # '[' 155 -ge 100 ']' 00:27:00.844 01:01:07 -- target/shutdown.sh@64 -- # ret=0 00:27:00.844 01:01:07 -- target/shutdown.sh@65 -- # break 00:27:00.844 01:01:07 -- target/shutdown.sh@69 -- # return 0 00:27:00.844 01:01:07 -- target/shutdown.sh@110 -- # killprocess 438151 00:27:00.844 01:01:07 -- common/autotest_common.sh@936 -- # '[' -z 438151 ']' 00:27:00.844 01:01:07 -- common/autotest_common.sh@940 -- # kill -0 438151 00:27:00.844 01:01:07 -- common/autotest_common.sh@941 -- # uname 00:27:00.844 01:01:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.844 01:01:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 438151 00:27:00.844 01:01:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:00.844 01:01:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:00.844 01:01:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 438151' 00:27:00.844 killing process with pid 438151 00:27:00.844 01:01:07 -- common/autotest_common.sh@955 -- # kill 438151 00:27:00.844 01:01:07 -- common/autotest_common.sh@960 -- # wait 438151 00:27:00.844 Received shutdown signal, test time was about 0.698039 seconds 00:27:00.844 00:27:00.844 Latency(us) 00:27:00.844 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.844 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme1n1 : 0.69 406.83 25.43 0.00 0.00 154155.41 7427.41 215928.98 00:27:00.844 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme2n1 : 0.69 394.72 24.67 0.00 0.00 154610.88 8204.14 153791.15 00:27:00.844 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme3n1 : 0.69 417.30 26.08 0.00 0.00 143491.48 8349.77 147577.36 00:27:00.844 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme4n1 : 0.69 418.14 26.13 0.00 0.00 139867.75 4247.70 139810.13 00:27:00.844 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme5n1 : 0.69 393.07 24.57 0.00 0.00 145091.56 8446.86 129712.73 00:27:00.844 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme6n1 : 0.69 412.68 25.79 0.00 0.00 135382.68 8543.95 121945.51 00:27:00.844 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme7n1 : 0.69 414.94 25.93 0.00 0.00 131546.16 8738.13 115731.72 00:27:00.844 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme8n1 : 0.70 405.73 25.36 0.00 0.00 131130.01 8883.77 107964.49 00:27:00.844 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme9n1 : 0.70 390.88 24.43 0.00 0.00 132491.59 8835.22 100197.26 00:27:00.844 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:00.844 Verification LBA range: start 0x0 length 0x400 00:27:00.844 Nvme10n1 : 0.70 367.14 22.95 0.00 0.00 138990.36 8543.95 164665.27 00:27:00.844 =================================================================================================================== 00:27:00.844 Total : 4021.44 251.34 0.00 0.00 140622.10 4247.70 215928.98 00:27:01.102 01:01:08 -- target/shutdown.sh@113 -- # sleep 1 00:27:02.037 01:01:09 -- target/shutdown.sh@114 -- # kill -0 437834 00:27:02.037 01:01:09 -- target/shutdown.sh@116 -- # stoptarget 00:27:02.037 01:01:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:27:02.037 01:01:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:27:02.037 01:01:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:27:02.037 01:01:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:27:02.037 01:01:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:02.037 01:01:09 -- nvmf/common.sh@117 -- # sync 00:27:02.037 01:01:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:02.037 01:01:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:02.037 01:01:09 -- nvmf/common.sh@120 -- # set +e 00:27:02.037 01:01:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:02.037 01:01:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:02.037 rmmod nvme_rdma 00:27:02.302 rmmod nvme_fabrics 00:27:02.303 01:01:09 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:02.303 01:01:09 -- nvmf/common.sh@124 -- # set -e 00:27:02.303 01:01:09 -- nvmf/common.sh@125 -- # return 0 00:27:02.303 01:01:09 -- nvmf/common.sh@478 -- # '[' -n 437834 ']' 00:27:02.303 01:01:09 -- nvmf/common.sh@479 -- # killprocess 437834 00:27:02.303 01:01:09 -- common/autotest_common.sh@936 -- # '[' -z 437834 ']' 00:27:02.303 01:01:09 -- common/autotest_common.sh@940 -- # kill -0 437834 00:27:02.303 01:01:09 -- common/autotest_common.sh@941 -- # uname 00:27:02.303 01:01:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:02.303 01:01:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 437834 00:27:02.303 01:01:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:02.303 01:01:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:02.303 01:01:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 437834' 00:27:02.303 killing process with pid 437834 00:27:02.303 01:01:09 -- common/autotest_common.sh@955 -- # kill 437834 00:27:02.303 01:01:09 -- common/autotest_common.sh@960 -- # wait 437834 00:27:02.303 [2024-04-26 01:01:09.373250] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:02.567 01:01:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:02.567 01:01:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:02.567 00:27:02.567 real 0m5.316s 00:27:02.567 user 0m21.337s 00:27:02.567 sys 0m1.014s 00:27:02.567 01:01:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:02.567 01:01:09 -- common/autotest_common.sh@10 -- # set +x 00:27:02.567 ************************************ 00:27:02.567 END TEST nvmf_shutdown_tc2 00:27:02.567 ************************************ 00:27:02.824 01:01:09 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:27:02.824 01:01:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:02.824 01:01:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:02.824 01:01:09 -- common/autotest_common.sh@10 -- # set +x 00:27:02.824 ************************************ 00:27:02.824 START TEST nvmf_shutdown_tc3 00:27:02.824 ************************************ 00:27:02.824 01:01:09 -- common/autotest_common.sh@1111 -- # nvmf_shutdown_tc3 00:27:02.824 01:01:09 -- target/shutdown.sh@121 -- # starttarget 00:27:02.824 01:01:09 -- target/shutdown.sh@15 -- # nvmftestinit 00:27:02.824 01:01:09 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:02.824 01:01:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:02.824 01:01:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:02.824 01:01:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:02.824 01:01:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:02.824 01:01:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:02.824 01:01:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:02.824 01:01:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:02.824 01:01:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:02.824 01:01:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:02.824 01:01:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:02.824 01:01:09 -- common/autotest_common.sh@10 -- # set +x 00:27:02.824 01:01:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:02.824 01:01:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:02.824 01:01:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:02.824 01:01:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:02.824 01:01:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:02.824 01:01:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:02.824 01:01:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:02.824 01:01:09 -- nvmf/common.sh@295 -- # net_devs=() 00:27:02.824 01:01:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:02.824 01:01:09 -- nvmf/common.sh@296 -- # e810=() 00:27:02.824 01:01:09 -- nvmf/common.sh@296 -- # local -ga e810 00:27:02.824 01:01:09 -- nvmf/common.sh@297 -- # x722=() 00:27:02.824 01:01:09 -- nvmf/common.sh@297 -- # local -ga x722 00:27:02.824 01:01:09 -- nvmf/common.sh@298 -- # mlx=() 00:27:02.824 01:01:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:02.824 01:01:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:02.824 01:01:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:02.825 01:01:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:02.825 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:02.825 01:01:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:02.825 01:01:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:02.825 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:02.825 01:01:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:02.825 01:01:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.825 01:01:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.825 01:01:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:02.825 Found net devices under 0000:18:00.0: mlx_0_0 00:27:02.825 01:01:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:02.825 01:01:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:02.825 01:01:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:02.825 Found net devices under 0000:18:00.1: mlx_0_1 00:27:02.825 01:01:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:02.825 01:01:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:02.825 01:01:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:02.825 01:01:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:02.825 01:01:09 -- nvmf/common.sh@58 -- # uname 00:27:02.825 01:01:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:02.825 01:01:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:02.825 01:01:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:02.825 01:01:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:02.825 01:01:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:02.825 01:01:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:02.825 01:01:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:02.825 01:01:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:02.825 01:01:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:02.825 01:01:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:02.825 01:01:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:02.825 01:01:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:02.825 01:01:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:02.825 01:01:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:02.825 01:01:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:02.825 01:01:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:02.825 01:01:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:02.825 01:01:09 -- nvmf/common.sh@105 -- # continue 2 00:27:02.825 01:01:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:02.825 01:01:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:02.825 01:01:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:02.825 01:01:09 -- nvmf/common.sh@105 -- # continue 2 00:27:02.825 01:01:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:02.825 01:01:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:02.825 01:01:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:02.825 01:01:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:02.825 01:01:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:02.825 01:01:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:02.825 01:01:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:02.825 01:01:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:02.825 01:01:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:02.825 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:02.825 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:02.825 altname enp24s0f0np0 00:27:02.825 altname ens785f0np0 00:27:02.825 inet 192.168.100.8/24 scope global mlx_0_0 00:27:02.825 valid_lft forever preferred_lft forever 00:27:02.825 01:01:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:02.825 01:01:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:02.825 01:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:02.825 01:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:02.825 01:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:02.825 01:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:03.083 01:01:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:03.083 01:01:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:03.083 01:01:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:03.083 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:03.083 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:03.083 altname enp24s0f1np1 00:27:03.083 altname ens785f1np1 00:27:03.083 inet 192.168.100.9/24 scope global mlx_0_1 00:27:03.083 valid_lft forever preferred_lft forever 00:27:03.083 01:01:10 -- nvmf/common.sh@411 -- # return 0 00:27:03.083 01:01:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:03.083 01:01:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:03.083 01:01:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:03.083 01:01:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:03.083 01:01:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:03.083 01:01:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:03.083 01:01:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:03.083 01:01:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:03.083 01:01:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:03.083 01:01:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:03.083 01:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:03.083 01:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:03.083 01:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:03.083 01:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:03.083 01:01:10 -- nvmf/common.sh@105 -- # continue 2 00:27:03.083 01:01:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:03.083 01:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:03.083 01:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:03.083 01:01:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:03.083 01:01:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:03.083 01:01:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:03.083 01:01:10 -- nvmf/common.sh@105 -- # continue 2 00:27:03.083 01:01:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:03.083 01:01:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:03.083 01:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:03.083 01:01:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:03.083 01:01:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:03.083 01:01:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:03.083 01:01:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:03.083 01:01:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:03.083 192.168.100.9' 00:27:03.083 01:01:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:03.083 192.168.100.9' 00:27:03.083 01:01:10 -- nvmf/common.sh@446 -- # head -n 1 00:27:03.083 01:01:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:03.083 01:01:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:03.083 192.168.100.9' 00:27:03.083 01:01:10 -- nvmf/common.sh@447 -- # tail -n +2 00:27:03.083 01:01:10 -- nvmf/common.sh@447 -- # head -n 1 00:27:03.083 01:01:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:03.083 01:01:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:03.083 01:01:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:03.083 01:01:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:03.083 01:01:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:03.083 01:01:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:03.083 01:01:10 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:27:03.083 01:01:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:03.083 01:01:10 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:03.083 01:01:10 -- common/autotest_common.sh@10 -- # set +x 00:27:03.083 01:01:10 -- nvmf/common.sh@470 -- # nvmfpid=438933 00:27:03.083 01:01:10 -- nvmf/common.sh@471 -- # waitforlisten 438933 00:27:03.083 01:01:10 -- common/autotest_common.sh@817 -- # '[' -z 438933 ']' 00:27:03.083 01:01:10 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:03.083 01:01:10 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:03.083 01:01:10 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:03.083 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:03.083 01:01:10 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:03.083 01:01:10 -- common/autotest_common.sh@10 -- # set +x 00:27:03.083 01:01:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:27:03.083 [2024-04-26 01:01:10.153955] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:03.083 [2024-04-26 01:01:10.153997] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:03.083 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.083 [2024-04-26 01:01:10.203285] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:03.341 [2024-04-26 01:01:10.275949] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:03.341 [2024-04-26 01:01:10.275978] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:03.341 [2024-04-26 01:01:10.275985] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:03.341 [2024-04-26 01:01:10.275990] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:03.341 [2024-04-26 01:01:10.275995] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:03.341 [2024-04-26 01:01:10.276087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:03.341 [2024-04-26 01:01:10.276101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:03.341 [2024-04-26 01:01:10.276211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:03.341 [2024-04-26 01:01:10.276212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:03.907 01:01:10 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:03.907 01:01:10 -- common/autotest_common.sh@850 -- # return 0 00:27:03.907 01:01:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:03.907 01:01:10 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:03.907 01:01:10 -- common/autotest_common.sh@10 -- # set +x 00:27:03.907 01:01:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:03.907 01:01:10 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:03.907 01:01:10 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:03.907 01:01:10 -- common/autotest_common.sh@10 -- # set +x 00:27:03.907 [2024-04-26 01:01:10.991384] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13cdb70/0x13d2060) succeed. 00:27:03.907 [2024-04-26 01:01:11.001768] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x13cf1b0/0x14136f0) succeed. 00:27:04.166 01:01:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:04.166 01:01:11 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:27:04.166 01:01:11 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:27:04.166 01:01:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:04.166 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:27:04.166 01:01:11 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:27:04.166 01:01:11 -- target/shutdown.sh@28 -- # cat 00:27:04.166 01:01:11 -- target/shutdown.sh@35 -- # rpc_cmd 00:27:04.166 01:01:11 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:04.166 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:27:04.166 Malloc1 00:27:04.166 [2024-04-26 01:01:11.204049] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:04.166 Malloc2 00:27:04.166 Malloc3 00:27:04.166 Malloc4 00:27:04.424 Malloc5 00:27:04.424 Malloc6 00:27:04.424 Malloc7 00:27:04.424 Malloc8 00:27:04.424 Malloc9 00:27:04.424 Malloc10 00:27:04.424 01:01:11 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:04.424 01:01:11 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:27:04.424 01:01:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:04.424 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:27:04.682 01:01:11 -- target/shutdown.sh@125 -- # perfpid=439254 00:27:04.682 01:01:11 -- target/shutdown.sh@126 -- # waitforlisten 439254 /var/tmp/bdevperf.sock 00:27:04.682 01:01:11 -- common/autotest_common.sh@817 -- # '[' -z 439254 ']' 00:27:04.682 01:01:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:04.682 01:01:11 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:27:04.682 01:01:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:04.682 01:01:11 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:27:04.682 01:01:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:04.682 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:04.682 01:01:11 -- nvmf/common.sh@521 -- # config=() 00:27:04.682 01:01:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:04.682 01:01:11 -- common/autotest_common.sh@10 -- # set +x 00:27:04.682 01:01:11 -- nvmf/common.sh@521 -- # local subsystem config 00:27:04.682 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.682 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 [2024-04-26 01:01:11.670051] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:04.683 [2024-04-26 01:01:11.670095] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid439254 ] 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 01:01:11 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:04.683 { 00:27:04.683 "params": { 00:27:04.683 "name": "Nvme$subsystem", 00:27:04.683 "trtype": "$TEST_TRANSPORT", 00:27:04.683 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:04.683 "adrfam": "ipv4", 00:27:04.683 "trsvcid": "$NVMF_PORT", 00:27:04.683 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:04.683 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:04.683 "hdgst": ${hdgst:-false}, 00:27:04.683 "ddgst": ${ddgst:-false} 00:27:04.683 }, 00:27:04.683 "method": "bdev_nvme_attach_controller" 00:27:04.683 } 00:27:04.683 EOF 00:27:04.683 )") 00:27:04.683 01:01:11 -- nvmf/common.sh@543 -- # cat 00:27:04.683 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.684 01:01:11 -- nvmf/common.sh@545 -- # jq . 00:27:04.684 01:01:11 -- nvmf/common.sh@546 -- # IFS=, 00:27:04.684 01:01:11 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme1", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme2", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme3", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme4", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme5", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme6", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme7", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme8", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme9", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 },{ 00:27:04.684 "params": { 00:27:04.684 "name": "Nvme10", 00:27:04.684 "trtype": "rdma", 00:27:04.684 "traddr": "192.168.100.8", 00:27:04.684 "adrfam": "ipv4", 00:27:04.684 "trsvcid": "4420", 00:27:04.684 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:27:04.684 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:27:04.684 "hdgst": false, 00:27:04.684 "ddgst": false 00:27:04.684 }, 00:27:04.684 "method": "bdev_nvme_attach_controller" 00:27:04.684 }' 00:27:04.684 [2024-04-26 01:01:11.721732] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.684 [2024-04-26 01:01:11.788098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:05.619 Running I/O for 10 seconds... 00:27:05.619 01:01:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:05.619 01:01:12 -- common/autotest_common.sh@850 -- # return 0 00:27:05.619 01:01:12 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:27:05.619 01:01:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:05.619 01:01:12 -- common/autotest_common.sh@10 -- # set +x 00:27:05.619 01:01:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:05.619 01:01:12 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:05.619 01:01:12 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:27:05.619 01:01:12 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:27:05.619 01:01:12 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:27:05.619 01:01:12 -- target/shutdown.sh@57 -- # local ret=1 00:27:05.619 01:01:12 -- target/shutdown.sh@58 -- # local i 00:27:05.619 01:01:12 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:27:05.619 01:01:12 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:27:05.619 01:01:12 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:27:05.619 01:01:12 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:27:05.619 01:01:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:05.619 01:01:12 -- common/autotest_common.sh@10 -- # set +x 00:27:05.877 01:01:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:05.877 01:01:12 -- target/shutdown.sh@60 -- # read_io_count=3 00:27:05.877 01:01:12 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:27:05.877 01:01:12 -- target/shutdown.sh@67 -- # sleep 0.25 00:27:06.139 01:01:13 -- target/shutdown.sh@59 -- # (( i-- )) 00:27:06.139 01:01:13 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:27:06.139 01:01:13 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:27:06.139 01:01:13 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:27:06.139 01:01:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:06.139 01:01:13 -- common/autotest_common.sh@10 -- # set +x 00:27:06.139 01:01:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:06.139 01:01:13 -- target/shutdown.sh@60 -- # read_io_count=146 00:27:06.139 01:01:13 -- target/shutdown.sh@63 -- # '[' 146 -ge 100 ']' 00:27:06.139 01:01:13 -- target/shutdown.sh@64 -- # ret=0 00:27:06.139 01:01:13 -- target/shutdown.sh@65 -- # break 00:27:06.139 01:01:13 -- target/shutdown.sh@69 -- # return 0 00:27:06.139 01:01:13 -- target/shutdown.sh@135 -- # killprocess 438933 00:27:06.139 01:01:13 -- common/autotest_common.sh@936 -- # '[' -z 438933 ']' 00:27:06.139 01:01:13 -- common/autotest_common.sh@940 -- # kill -0 438933 00:27:06.139 01:01:13 -- common/autotest_common.sh@941 -- # uname 00:27:06.139 01:01:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:06.139 01:01:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 438933 00:27:06.139 01:01:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:06.139 01:01:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:06.139 01:01:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 438933' 00:27:06.139 killing process with pid 438933 00:27:06.139 01:01:13 -- common/autotest_common.sh@955 -- # kill 438933 00:27:06.139 01:01:13 -- common/autotest_common.sh@960 -- # wait 438933 00:27:06.399 [2024-04-26 01:01:13.431150] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:06.660 01:01:13 -- target/shutdown.sh@136 -- # nvmfpid= 00:27:06.660 01:01:13 -- target/shutdown.sh@139 -- # sleep 1 00:27:07.235 [2024-04-26 01:01:14.384957] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257b00 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.387360] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192578c0 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.389923] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257680 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.392501] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257440 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.394940] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257200 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.397370] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256fc0 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.399459] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256d80 was disconnected and freed. reset controller. 00:27:07.235 [2024-04-26 01:01:14.399506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001addff80 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adcff00 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adbfe80 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001adafe00 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad9fd80 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad8fd00 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad7fc80 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad6fc00 len:0x10000 key:0x183100 00:27:07.235 [2024-04-26 01:01:14.399663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.235 [2024-04-26 01:01:14.399673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad5fb80 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad4fb00 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad3fa80 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad2fa00 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad1f980 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ad0f900 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acff880 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acef800 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acdf780 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001accf700 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acbf680 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001acaf600 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac9f580 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac8f500 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac7f480 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac6f400 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac5f380 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.399987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac4f300 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.399995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac3f280 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.400013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac2f200 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.400031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac1f180 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.400050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ac0f100 len:0x10000 key:0x183100 00:27:07.236 [2024-04-26 01:01:14.400067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aff0000 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afdff80 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afcff00 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afbfe80 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001afafe00 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af9fd80 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af8fd00 len:0x10000 key:0x183200 00:27:07.236 [2024-04-26 01:01:14.400195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.236 [2024-04-26 01:01:14.400206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af7fc80 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af6fc00 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af5fb80 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af4fb00 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af3fa80 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af2fa00 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af1f980 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001af0f900 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aeff880 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aeef800 len:0x10000 key:0x183200 00:27:07.237 [2024-04-26 01:01:14.400399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001a80f100 len:0x10000 key:0x183600 00:27:07.237 [2024-04-26 01:01:14.400419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011f40000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011f61000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011f82000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011fa3000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011fc4000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200011fe5000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012006000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012027000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012048000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200012069000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001208a000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000120ab000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000120cc000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000120ed000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001210e000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.400705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001212f000 len:0x10000 key:0x182800 00:27:07.237 [2024-04-26 01:01:14.400713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32740 cdw0:2a125800 sqhd:846e p:0 m:0 dnr:0 00:27:07.237 [2024-04-26 01:01:14.403235] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256b40 was disconnected and freed. reset controller. 00:27:07.238 [2024-04-26 01:01:14.403261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0dfd80 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0cfd00 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0bfc80 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0afc00 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b09fb80 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b08fb00 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b07fa80 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:33664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b06fa00 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:33792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b05f980 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:33920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b04f900 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b03f880 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b02f800 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b01f780 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b00f700 len:0x10000 key:0x182e00 00:27:07.238 [2024-04-26 01:01:14.403525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:34560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aedf780 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:34688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aecf700 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aebf680 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001aeaf600 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae9f580 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:35200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae8f500 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:35328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae7f480 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae6f400 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae5f380 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae4f300 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae3f280 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae2f200 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae1f180 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001ae0f100 len:0x10000 key:0x183200 00:27:07.238 [2024-04-26 01:01:14.403779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3f0000 len:0x10000 key:0x183900 00:27:07.238 [2024-04-26 01:01:14.403797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.238 [2024-04-26 01:01:14.403808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3dff80 len:0x10000 key:0x183900 00:27:07.238 [2024-04-26 01:01:14.403816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:36608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3cff00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:36736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3bfe80 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:36864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b3afe00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b39fd80 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b38fd00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b37fc80 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b36fc00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b35fb80 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b34fb00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.403980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.403992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b33fa80 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.239 [2024-04-26 01:01:14.404327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x183900 00:27:07.239 [2024-04-26 01:01:14.404335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x183900 00:27:07.240 [2024-04-26 01:01:14.404353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.404372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5dff80 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.404390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5cff00 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.404410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5bfe80 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.404428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.404439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0efe00 len:0x10000 key:0x182e00 00:27:07.240 [2024-04-26 01:01:14.404446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:402e540 sqhd:c500 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406427] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256900 was disconnected and freed. reset controller. 00:27:07.240 [2024-04-26 01:01:14.406446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x183c00 00:27:07.240 [2024-04-26 01:01:14.406631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x183e00 00:27:07.240 [2024-04-26 01:01:14.406794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.240 [2024-04-26 01:01:14.406804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.406986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.406995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.241 [2024-04-26 01:01:14.407133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x183e00 00:27:07.241 [2024-04-26 01:01:14.407143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x183e00 00:27:07.242 [2024-04-26 01:01:14.407161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x183e00 00:27:07.242 [2024-04-26 01:01:14.407179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x183e00 00:27:07.242 [2024-04-26 01:01:14.407198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.407363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.407371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.413906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.413933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.413947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.413956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.413966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.413974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.413984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.413998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8bf680 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8af600 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b89f580 len:0x10000 key:0x184000 00:27:07.242 [2024-04-26 01:01:14.414157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.414168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x183c00 00:27:07.242 [2024-04-26 01:01:14.414175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:40bf440 sqhd:ef10 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.417172] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192566c0 was disconnected and freed. reset controller. 00:27:07.242 [2024-04-26 01:01:14.417288] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.242 [2024-04-26 01:01:14.417302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.242 [2024-04-26 01:01:14.417312] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.242 [2024-04-26 01:01:14.417321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.417330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.417338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.417347] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.417355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.419076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.243 [2024-04-26 01:01:14.419089] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:27:07.243 [2024-04-26 01:01:14.419098] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.243 [2024-04-26 01:01:14.419113] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.419122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.419130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.419138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.419147] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.419155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.419164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.419171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.421276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.243 [2024-04-26 01:01:14.421288] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:27:07.243 [2024-04-26 01:01:14.421295] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.243 [2024-04-26 01:01:14.421309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.421318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.421327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.421335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.421344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.421354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.421363] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.421370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.423041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.243 [2024-04-26 01:01:14.423071] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:27:07.243 [2024-04-26 01:01:14.423090] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.243 [2024-04-26 01:01:14.423122] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.423145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.243 [2024-04-26 01:01:14.423168] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.243 [2024-04-26 01:01:14.423189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.423211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.423233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.423267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.423288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.425474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.425504] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:27:07.505 [2024-04-26 01:01:14.425523] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.425555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.425578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.425601] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.425622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.425645] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.425666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.425688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.425709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.427822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.427859] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:07.505 [2024-04-26 01:01:14.427878] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.427911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.427932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.427955] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.427975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.427998] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.428019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.428041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.428062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.430159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.430189] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:27:07.505 [2024-04-26 01:01:14.430207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.430253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.430278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.430301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.430322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.430344] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.430366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.430388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.430410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.432369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.432399] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:27:07.505 [2024-04-26 01:01:14.432417] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.432450] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.432473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.432502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.432524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.432547] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.432568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.432591] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.432613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.434603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.434632] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:27:07.505 [2024-04-26 01:01:14.434650] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.434683] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.434706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.434729] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.434750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.434772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.434793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.434816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.434837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.436747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.505 [2024-04-26 01:01:14.436779] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:27:07.505 [2024-04-26 01:01:14.436797] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.505 [2024-04-26 01:01:14.436831] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.436854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.505 [2024-04-26 01:01:14.436876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.505 [2024-04-26 01:01:14.436898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.506 [2024-04-26 01:01:14.436921] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.506 [2024-04-26 01:01:14.436942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.506 [2024-04-26 01:01:14.436971] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:27:07.506 [2024-04-26 01:01:14.436993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:36794 cdw0:0 sqhd:3b00 p:1 m:0 dnr:0 00:27:07.506 [2024-04-26 01:01:14.454392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:07.506 [2024-04-26 01:01:14.454405] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:27:07.506 [2024-04-26 01:01:14.454411] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.461955] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:07.506 [2024-04-26 01:01:14.461978] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:27:07.506 [2024-04-26 01:01:14.461986] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:27:07.506 [2024-04-26 01:01:14.462035] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462045] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462064] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462073] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462080] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462089] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:27:07.506 [2024-04-26 01:01:14.462163] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:27:07.506 [2024-04-26 01:01:14.462172] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:27:07.506 [2024-04-26 01:01:14.462179] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:27:07.506 [2024-04-26 01:01:14.462188] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:27:07.506 [2024-04-26 01:01:14.464255] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:27:07.506 task offset: 32768 on job bdev=Nvme6n1 fails 00:27:07.506 00:27:07.506 Latency(us) 00:27:07.506 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:07.506 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme1n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme1n1 : 1.81 141.38 8.84 35.35 0.00 360287.19 25437.68 1062557.01 00:27:07.506 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme2n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme2n1 : 1.81 144.08 9.01 35.33 0.00 351921.34 4004.98 1062557.01 00:27:07.506 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme3n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme3n1 : 1.81 141.26 8.83 35.32 0.00 354703.59 29515.47 1062557.01 00:27:07.506 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme4n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme4n1 : 1.81 158.85 9.93 35.30 0.00 319953.04 6407.96 1068770.80 00:27:07.506 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme5n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme5n1 : 1.81 141.14 8.82 35.29 0.00 349221.02 36117.62 1068770.80 00:27:07.506 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme6n1 ended in about 1.81 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme6n1 : 1.81 141.09 8.82 35.27 0.00 346276.14 49516.09 1062557.01 00:27:07.506 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme7n1 ended in about 1.82 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme7n1 : 1.82 152.05 9.50 35.26 0.00 323221.55 12718.84 1062557.01 00:27:07.506 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme8n1 ended in about 1.82 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme8n1 : 1.82 140.97 8.81 35.24 0.00 341218.65 18350.08 1130908.63 00:27:07.506 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme9n1 ended in about 1.82 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme9n1 : 1.82 140.91 8.81 35.23 0.00 338565.04 47380.10 1118481.07 00:27:07.506 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:27:07.506 Job: Nvme10n1 ended in about 1.82 seconds with error 00:27:07.506 Verification LBA range: start 0x0 length 0x400 00:27:07.506 Nvme10n1 : 1.82 105.64 6.60 35.21 0.00 419547.59 49321.91 1106053.50 00:27:07.506 =================================================================================================================== 00:27:07.506 Total : 1407.38 87.96 352.79 0.00 348632.74 4004.98 1130908.63 00:27:07.506 [2024-04-26 01:01:14.483411] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:27:07.506 [2024-04-26 01:01:14.483429] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:27:07.506 [2024-04-26 01:01:14.483440] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:27:07.506 [2024-04-26 01:01:14.492738] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.492786] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.492807] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:27:07.506 [2024-04-26 01:01:14.492937] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.492962] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.492979] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:27:07.506 [2024-04-26 01:01:14.493095] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.493119] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.493136] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:27:07.506 [2024-04-26 01:01:14.496106] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.496166] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.496186] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:27:07.506 [2024-04-26 01:01:14.496302] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.496328] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.496345] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:27:07.506 [2024-04-26 01:01:14.496446] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.496471] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.496487] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:27:07.506 [2024-04-26 01:01:14.496584] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.496593] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.496599] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:27:07.506 [2024-04-26 01:01:14.497162] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.497174] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.506 [2024-04-26 01:01:14.497180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:27:07.506 [2024-04-26 01:01:14.497271] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.506 [2024-04-26 01:01:14.497281] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.507 [2024-04-26 01:01:14.497287] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:27:07.507 [2024-04-26 01:01:14.497371] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:27:07.507 [2024-04-26 01:01:14.497381] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:27:07.507 [2024-04-26 01:01:14.497387] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:27:07.767 01:01:14 -- target/shutdown.sh@142 -- # kill -9 439254 00:27:07.767 01:01:14 -- target/shutdown.sh@144 -- # stoptarget 00:27:07.767 01:01:14 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:27:07.767 01:01:14 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:27:07.767 01:01:14 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:27:07.767 01:01:14 -- target/shutdown.sh@45 -- # nvmftestfini 00:27:07.767 01:01:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:07.767 01:01:14 -- nvmf/common.sh@117 -- # sync 00:27:07.767 01:01:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:07.767 01:01:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:07.767 01:01:14 -- nvmf/common.sh@120 -- # set +e 00:27:07.767 01:01:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:07.767 01:01:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:07.767 rmmod nvme_rdma 00:27:07.767 rmmod nvme_fabrics 00:27:07.767 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 439254 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:27:07.767 01:01:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:07.767 01:01:14 -- nvmf/common.sh@124 -- # set -e 00:27:07.767 01:01:14 -- nvmf/common.sh@125 -- # return 0 00:27:07.767 01:01:14 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:27:07.767 01:01:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:07.767 01:01:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:07.767 00:27:07.767 real 0m4.971s 00:27:07.767 user 0m16.984s 00:27:07.767 sys 0m0.983s 00:27:07.767 01:01:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:07.767 01:01:14 -- common/autotest_common.sh@10 -- # set +x 00:27:07.767 ************************************ 00:27:07.767 END TEST nvmf_shutdown_tc3 00:27:07.767 ************************************ 00:27:07.767 01:01:14 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:27:07.767 00:27:07.767 real 0m22.822s 00:27:07.767 user 1m8.492s 00:27:07.767 sys 0m7.273s 00:27:07.767 01:01:14 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:07.767 01:01:14 -- common/autotest_common.sh@10 -- # set +x 00:27:07.767 ************************************ 00:27:07.767 END TEST nvmf_shutdown 00:27:07.767 ************************************ 00:27:07.767 01:01:14 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:27:07.767 01:01:14 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:07.767 01:01:14 -- common/autotest_common.sh@10 -- # set +x 00:27:08.027 01:01:14 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:27:08.027 01:01:14 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:08.027 01:01:14 -- common/autotest_common.sh@10 -- # set +x 00:27:08.027 01:01:14 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:27:08.027 01:01:14 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:27:08.027 01:01:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:08.027 01:01:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:08.027 01:01:14 -- common/autotest_common.sh@10 -- # set +x 00:27:08.027 ************************************ 00:27:08.027 START TEST nvmf_multicontroller 00:27:08.027 ************************************ 00:27:08.027 01:01:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:27:08.027 * Looking for test storage... 00:27:08.027 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:08.027 01:01:15 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:08.027 01:01:15 -- nvmf/common.sh@7 -- # uname -s 00:27:08.027 01:01:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:08.027 01:01:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:08.027 01:01:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:08.288 01:01:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:08.288 01:01:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:08.288 01:01:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:08.288 01:01:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:08.288 01:01:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:08.288 01:01:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:08.288 01:01:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:08.288 01:01:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:08.288 01:01:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:08.288 01:01:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:08.288 01:01:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:08.288 01:01:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:08.288 01:01:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:08.288 01:01:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:08.288 01:01:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:08.288 01:01:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:08.288 01:01:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:08.288 01:01:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.288 01:01:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.288 01:01:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.288 01:01:15 -- paths/export.sh@5 -- # export PATH 00:27:08.288 01:01:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.288 01:01:15 -- nvmf/common.sh@47 -- # : 0 00:27:08.288 01:01:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:08.288 01:01:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:08.288 01:01:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:08.288 01:01:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:08.288 01:01:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:08.288 01:01:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:08.288 01:01:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:08.288 01:01:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:08.288 01:01:15 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:08.288 01:01:15 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:08.288 01:01:15 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:27:08.288 01:01:15 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:27:08.288 01:01:15 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:08.288 01:01:15 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:27:08.288 01:01:15 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:27:08.288 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:27:08.288 01:01:15 -- host/multicontroller.sh@20 -- # exit 0 00:27:08.288 00:27:08.288 real 0m0.114s 00:27:08.288 user 0m0.057s 00:27:08.288 sys 0m0.065s 00:27:08.288 01:01:15 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:08.288 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:27:08.288 ************************************ 00:27:08.288 END TEST nvmf_multicontroller 00:27:08.288 ************************************ 00:27:08.288 01:01:15 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:27:08.288 01:01:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:08.288 01:01:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:08.288 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:27:08.288 ************************************ 00:27:08.288 START TEST nvmf_aer 00:27:08.288 ************************************ 00:27:08.288 01:01:15 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:27:08.548 * Looking for test storage... 00:27:08.548 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:08.548 01:01:15 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:08.548 01:01:15 -- nvmf/common.sh@7 -- # uname -s 00:27:08.548 01:01:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:08.548 01:01:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:08.548 01:01:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:08.548 01:01:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:08.548 01:01:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:08.548 01:01:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:08.548 01:01:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:08.548 01:01:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:08.548 01:01:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:08.548 01:01:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:08.549 01:01:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:08.549 01:01:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:08.549 01:01:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:08.549 01:01:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:08.549 01:01:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:08.549 01:01:15 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:08.549 01:01:15 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:08.549 01:01:15 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:08.549 01:01:15 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:08.549 01:01:15 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:08.549 01:01:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.549 01:01:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.549 01:01:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.549 01:01:15 -- paths/export.sh@5 -- # export PATH 00:27:08.549 01:01:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.549 01:01:15 -- nvmf/common.sh@47 -- # : 0 00:27:08.549 01:01:15 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:08.549 01:01:15 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:08.549 01:01:15 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:08.549 01:01:15 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:08.549 01:01:15 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:08.549 01:01:15 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:08.549 01:01:15 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:08.549 01:01:15 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:08.549 01:01:15 -- host/aer.sh@11 -- # nvmftestinit 00:27:08.549 01:01:15 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:08.549 01:01:15 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:08.549 01:01:15 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:08.549 01:01:15 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:08.549 01:01:15 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:08.549 01:01:15 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:08.549 01:01:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:08.549 01:01:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:08.549 01:01:15 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:08.549 01:01:15 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:08.549 01:01:15 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:08.549 01:01:15 -- common/autotest_common.sh@10 -- # set +x 00:27:13.830 01:01:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:13.830 01:01:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:13.830 01:01:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:13.830 01:01:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:13.830 01:01:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:13.830 01:01:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:13.830 01:01:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:13.830 01:01:20 -- nvmf/common.sh@295 -- # net_devs=() 00:27:13.830 01:01:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:13.830 01:01:20 -- nvmf/common.sh@296 -- # e810=() 00:27:13.830 01:01:20 -- nvmf/common.sh@296 -- # local -ga e810 00:27:13.830 01:01:20 -- nvmf/common.sh@297 -- # x722=() 00:27:13.830 01:01:20 -- nvmf/common.sh@297 -- # local -ga x722 00:27:13.830 01:01:20 -- nvmf/common.sh@298 -- # mlx=() 00:27:13.830 01:01:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:13.830 01:01:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:13.830 01:01:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:13.830 01:01:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:13.830 01:01:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:13.830 01:01:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:13.830 01:01:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:13.830 01:01:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:13.830 01:01:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:13.830 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:13.830 01:01:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:13.830 01:01:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:13.830 01:01:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:13.830 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:13.830 01:01:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:13.830 01:01:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:13.830 01:01:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:13.830 01:01:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:13.830 01:01:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:13.830 01:01:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:13.830 01:01:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:13.831 01:01:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:13.831 Found net devices under 0000:18:00.0: mlx_0_0 00:27:13.831 01:01:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:13.831 01:01:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:13.831 01:01:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:13.831 01:01:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:13.831 01:01:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:13.831 01:01:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:13.831 Found net devices under 0000:18:00.1: mlx_0_1 00:27:13.831 01:01:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:13.831 01:01:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:13.831 01:01:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:13.831 01:01:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:13.831 01:01:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:13.831 01:01:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:13.831 01:01:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:13.831 01:01:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:13.831 01:01:20 -- nvmf/common.sh@58 -- # uname 00:27:13.831 01:01:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:13.831 01:01:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:13.831 01:01:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:13.831 01:01:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:13.831 01:01:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:13.831 01:01:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:13.831 01:01:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:14.090 01:01:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:14.090 01:01:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:14.090 01:01:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:14.090 01:01:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:14.090 01:01:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:14.090 01:01:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:14.090 01:01:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:14.090 01:01:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:14.090 01:01:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:14.090 01:01:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@105 -- # continue 2 00:27:14.090 01:01:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:14.090 01:01:21 -- nvmf/common.sh@105 -- # continue 2 00:27:14.090 01:01:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:14.090 01:01:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:14.090 01:01:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:14.090 01:01:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:14.090 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:14.090 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:14.090 altname enp24s0f0np0 00:27:14.090 altname ens785f0np0 00:27:14.090 inet 192.168.100.8/24 scope global mlx_0_0 00:27:14.090 valid_lft forever preferred_lft forever 00:27:14.090 01:01:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:14.090 01:01:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:14.090 01:01:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:14.090 01:01:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:14.090 01:01:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:14.090 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:14.090 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:14.090 altname enp24s0f1np1 00:27:14.090 altname ens785f1np1 00:27:14.090 inet 192.168.100.9/24 scope global mlx_0_1 00:27:14.090 valid_lft forever preferred_lft forever 00:27:14.090 01:01:21 -- nvmf/common.sh@411 -- # return 0 00:27:14.090 01:01:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:14.090 01:01:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:14.090 01:01:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:14.090 01:01:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:14.090 01:01:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:14.090 01:01:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:14.090 01:01:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:14.090 01:01:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:14.090 01:01:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:14.090 01:01:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@105 -- # continue 2 00:27:14.090 01:01:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:14.090 01:01:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:14.090 01:01:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:14.090 01:01:21 -- nvmf/common.sh@105 -- # continue 2 00:27:14.090 01:01:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:14.090 01:01:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:14.090 01:01:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:14.091 01:01:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:14.091 01:01:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:14.091 01:01:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:14.091 01:01:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:14.091 01:01:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:14.091 01:01:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:14.091 01:01:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:14.091 01:01:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:14.091 192.168.100.9' 00:27:14.091 01:01:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:14.091 192.168.100.9' 00:27:14.091 01:01:21 -- nvmf/common.sh@446 -- # head -n 1 00:27:14.091 01:01:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:14.091 01:01:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:14.091 192.168.100.9' 00:27:14.091 01:01:21 -- nvmf/common.sh@447 -- # tail -n +2 00:27:14.091 01:01:21 -- nvmf/common.sh@447 -- # head -n 1 00:27:14.091 01:01:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:14.091 01:01:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:14.091 01:01:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:14.091 01:01:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:14.091 01:01:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:14.091 01:01:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:14.091 01:01:21 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:27:14.091 01:01:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:14.091 01:01:21 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:14.091 01:01:21 -- common/autotest_common.sh@10 -- # set +x 00:27:14.091 01:01:21 -- nvmf/common.sh@470 -- # nvmfpid=443270 00:27:14.091 01:01:21 -- nvmf/common.sh@471 -- # waitforlisten 443270 00:27:14.091 01:01:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:14.091 01:01:21 -- common/autotest_common.sh@817 -- # '[' -z 443270 ']' 00:27:14.091 01:01:21 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:14.091 01:01:21 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:14.091 01:01:21 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:14.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:14.091 01:01:21 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:14.091 01:01:21 -- common/autotest_common.sh@10 -- # set +x 00:27:14.091 [2024-04-26 01:01:21.232923] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:14.091 [2024-04-26 01:01:21.232966] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:14.091 EAL: No free 2048 kB hugepages reported on node 1 00:27:14.091 [2024-04-26 01:01:21.281999] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:14.350 [2024-04-26 01:01:21.353155] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:14.350 [2024-04-26 01:01:21.353193] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:14.350 [2024-04-26 01:01:21.353200] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:14.350 [2024-04-26 01:01:21.353205] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:14.350 [2024-04-26 01:01:21.353209] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:14.350 [2024-04-26 01:01:21.353243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.350 [2024-04-26 01:01:21.353336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:14.350 [2024-04-26 01:01:21.353425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:14.350 [2024-04-26 01:01:21.353426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:14.918 01:01:22 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:14.918 01:01:22 -- common/autotest_common.sh@850 -- # return 0 00:27:14.918 01:01:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:14.918 01:01:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:14.918 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:14.918 01:01:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:14.918 01:01:22 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:27:14.918 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:14.918 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:14.918 [2024-04-26 01:01:22.076069] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xbdd880/0xbe1d70) succeed. 00:27:14.918 [2024-04-26 01:01:22.085481] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xbdeec0/0xc23400) succeed. 00:27:15.178 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.178 01:01:22 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:27:15.178 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.178 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.178 Malloc0 00:27:15.178 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.178 01:01:22 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:27:15.178 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.178 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.178 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.178 01:01:22 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:15.178 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.178 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.178 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.178 01:01:22 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:27:15.178 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.178 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.178 [2024-04-26 01:01:22.244463] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:15.178 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.178 01:01:22 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:27:15.178 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.178 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.178 [2024-04-26 01:01:22.252099] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:15.178 [ 00:27:15.178 { 00:27:15.178 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:15.178 "subtype": "Discovery", 00:27:15.178 "listen_addresses": [], 00:27:15.178 "allow_any_host": true, 00:27:15.178 "hosts": [] 00:27:15.178 }, 00:27:15.178 { 00:27:15.178 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:15.178 "subtype": "NVMe", 00:27:15.178 "listen_addresses": [ 00:27:15.178 { 00:27:15.178 "transport": "RDMA", 00:27:15.178 "trtype": "RDMA", 00:27:15.178 "adrfam": "IPv4", 00:27:15.178 "traddr": "192.168.100.8", 00:27:15.178 "trsvcid": "4420" 00:27:15.178 } 00:27:15.178 ], 00:27:15.178 "allow_any_host": true, 00:27:15.178 "hosts": [], 00:27:15.178 "serial_number": "SPDK00000000000001", 00:27:15.178 "model_number": "SPDK bdev Controller", 00:27:15.178 "max_namespaces": 2, 00:27:15.178 "min_cntlid": 1, 00:27:15.178 "max_cntlid": 65519, 00:27:15.178 "namespaces": [ 00:27:15.178 { 00:27:15.178 "nsid": 1, 00:27:15.178 "bdev_name": "Malloc0", 00:27:15.178 "name": "Malloc0", 00:27:15.178 "nguid": "BFF2344986DF4433B2530FC148559310", 00:27:15.178 "uuid": "bff23449-86df-4433-b253-0fc148559310" 00:27:15.178 } 00:27:15.178 ] 00:27:15.179 } 00:27:15.179 ] 00:27:15.179 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.179 01:01:22 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:27:15.179 01:01:22 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:27:15.179 01:01:22 -- host/aer.sh@33 -- # aerpid=443546 00:27:15.179 01:01:22 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:27:15.179 01:01:22 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:27:15.179 01:01:22 -- common/autotest_common.sh@1251 -- # local i=0 00:27:15.179 01:01:22 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:15.179 01:01:22 -- common/autotest_common.sh@1253 -- # '[' 0 -lt 200 ']' 00:27:15.179 01:01:22 -- common/autotest_common.sh@1254 -- # i=1 00:27:15.179 01:01:22 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:27:15.179 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.438 01:01:22 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:15.438 01:01:22 -- common/autotest_common.sh@1253 -- # '[' 1 -lt 200 ']' 00:27:15.438 01:01:22 -- common/autotest_common.sh@1254 -- # i=2 00:27:15.438 01:01:22 -- common/autotest_common.sh@1255 -- # sleep 0.1 00:27:15.438 01:01:22 -- common/autotest_common.sh@1252 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:15.438 01:01:22 -- common/autotest_common.sh@1258 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:27:15.439 01:01:22 -- common/autotest_common.sh@1262 -- # return 0 00:27:15.439 01:01:22 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 Malloc1 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 [ 00:27:15.439 { 00:27:15.439 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:15.439 "subtype": "Discovery", 00:27:15.439 "listen_addresses": [], 00:27:15.439 "allow_any_host": true, 00:27:15.439 "hosts": [] 00:27:15.439 }, 00:27:15.439 { 00:27:15.439 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:15.439 "subtype": "NVMe", 00:27:15.439 "listen_addresses": [ 00:27:15.439 { 00:27:15.439 "transport": "RDMA", 00:27:15.439 "trtype": "RDMA", 00:27:15.439 "adrfam": "IPv4", 00:27:15.439 "traddr": "192.168.100.8", 00:27:15.439 "trsvcid": "4420" 00:27:15.439 } 00:27:15.439 ], 00:27:15.439 "allow_any_host": true, 00:27:15.439 "hosts": [], 00:27:15.439 "serial_number": "SPDK00000000000001", 00:27:15.439 "model_number": "SPDK bdev Controller", 00:27:15.439 "max_namespaces": 2, 00:27:15.439 "min_cntlid": 1, 00:27:15.439 "max_cntlid": 65519, 00:27:15.439 "namespaces": [ 00:27:15.439 { 00:27:15.439 "nsid": 1, 00:27:15.439 "bdev_name": "Malloc0", 00:27:15.439 "name": "Malloc0", 00:27:15.439 "nguid": "BFF2344986DF4433B2530FC148559310", 00:27:15.439 "uuid": "bff23449-86df-4433-b253-0fc148559310" 00:27:15.439 }, 00:27:15.439 { 00:27:15.439 "nsid": 2, 00:27:15.439 "bdev_name": "Malloc1", 00:27:15.439 "name": "Malloc1", 00:27:15.439 "nguid": "ADE440B1D2EA4042829A1D99B1058A20", 00:27:15.439 "uuid": "ade440b1-d2ea-4042-829a-1d99b1058a20" 00:27:15.439 } 00:27:15.439 ] 00:27:15.439 } 00:27:15.439 ] 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@43 -- # wait 443546 00:27:15.439 Asynchronous Event Request test 00:27:15.439 Attaching to 192.168.100.8 00:27:15.439 Attached to 192.168.100.8 00:27:15.439 Registering asynchronous event callbacks... 00:27:15.439 Starting namespace attribute notice tests for all controllers... 00:27:15.439 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:27:15.439 aer_cb - Changed Namespace 00:27:15.439 Cleaning up... 00:27:15.439 01:01:22 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:15.439 01:01:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:15.439 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.439 01:01:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:15.439 01:01:22 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:27:15.439 01:01:22 -- host/aer.sh@51 -- # nvmftestfini 00:27:15.439 01:01:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:15.439 01:01:22 -- nvmf/common.sh@117 -- # sync 00:27:15.439 01:01:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:15.439 01:01:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:15.439 01:01:22 -- nvmf/common.sh@120 -- # set +e 00:27:15.439 01:01:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:15.439 01:01:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:15.706 rmmod nvme_rdma 00:27:15.706 rmmod nvme_fabrics 00:27:15.706 01:01:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:15.706 01:01:22 -- nvmf/common.sh@124 -- # set -e 00:27:15.706 01:01:22 -- nvmf/common.sh@125 -- # return 0 00:27:15.706 01:01:22 -- nvmf/common.sh@478 -- # '[' -n 443270 ']' 00:27:15.706 01:01:22 -- nvmf/common.sh@479 -- # killprocess 443270 00:27:15.706 01:01:22 -- common/autotest_common.sh@936 -- # '[' -z 443270 ']' 00:27:15.706 01:01:22 -- common/autotest_common.sh@940 -- # kill -0 443270 00:27:15.706 01:01:22 -- common/autotest_common.sh@941 -- # uname 00:27:15.706 01:01:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.706 01:01:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 443270 00:27:15.706 01:01:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:15.706 01:01:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:15.706 01:01:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 443270' 00:27:15.706 killing process with pid 443270 00:27:15.706 01:01:22 -- common/autotest_common.sh@955 -- # kill 443270 00:27:15.706 [2024-04-26 01:01:22.712518] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:15.706 01:01:22 -- common/autotest_common.sh@960 -- # wait 443270 00:27:15.706 [2024-04-26 01:01:22.789413] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:15.967 01:01:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:15.967 01:01:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:15.967 00:27:15.967 real 0m7.570s 00:27:15.967 user 0m7.901s 00:27:15.967 sys 0m4.787s 00:27:15.967 01:01:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:15.967 01:01:22 -- common/autotest_common.sh@10 -- # set +x 00:27:15.967 ************************************ 00:27:15.967 END TEST nvmf_aer 00:27:15.967 ************************************ 00:27:15.967 01:01:23 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:27:15.967 01:01:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:15.967 01:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:15.967 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:27:15.967 ************************************ 00:27:15.967 START TEST nvmf_async_init 00:27:15.967 ************************************ 00:27:15.967 01:01:23 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:27:16.226 * Looking for test storage... 00:27:16.226 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:16.226 01:01:23 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:16.226 01:01:23 -- nvmf/common.sh@7 -- # uname -s 00:27:16.226 01:01:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:16.226 01:01:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:16.226 01:01:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:16.226 01:01:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:16.226 01:01:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:16.226 01:01:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:16.226 01:01:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:16.226 01:01:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:16.226 01:01:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:16.226 01:01:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:16.226 01:01:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:16.226 01:01:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:16.226 01:01:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:16.226 01:01:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:16.226 01:01:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:16.226 01:01:23 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:16.226 01:01:23 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:16.226 01:01:23 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:16.226 01:01:23 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:16.226 01:01:23 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:16.226 01:01:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.226 01:01:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.226 01:01:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.226 01:01:23 -- paths/export.sh@5 -- # export PATH 00:27:16.226 01:01:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:16.226 01:01:23 -- nvmf/common.sh@47 -- # : 0 00:27:16.226 01:01:23 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:16.226 01:01:23 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:16.226 01:01:23 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:16.226 01:01:23 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:16.226 01:01:23 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:16.226 01:01:23 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:16.226 01:01:23 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:16.226 01:01:23 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:16.226 01:01:23 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:27:16.226 01:01:23 -- host/async_init.sh@14 -- # null_block_size=512 00:27:16.226 01:01:23 -- host/async_init.sh@15 -- # null_bdev=null0 00:27:16.226 01:01:23 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:27:16.226 01:01:23 -- host/async_init.sh@20 -- # tr -d - 00:27:16.226 01:01:23 -- host/async_init.sh@20 -- # uuidgen 00:27:16.226 01:01:23 -- host/async_init.sh@20 -- # nguid=cae6b98ffb23420c921f6184346bf427 00:27:16.226 01:01:23 -- host/async_init.sh@22 -- # nvmftestinit 00:27:16.226 01:01:23 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:16.226 01:01:23 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:16.226 01:01:23 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:16.226 01:01:23 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:16.226 01:01:23 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:16.226 01:01:23 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:16.226 01:01:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:16.226 01:01:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:16.226 01:01:23 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:16.226 01:01:23 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:16.226 01:01:23 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:16.226 01:01:23 -- common/autotest_common.sh@10 -- # set +x 00:27:21.512 01:01:28 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:21.512 01:01:28 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:21.512 01:01:28 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:21.512 01:01:28 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:21.512 01:01:28 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:21.512 01:01:28 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:21.512 01:01:28 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:21.512 01:01:28 -- nvmf/common.sh@295 -- # net_devs=() 00:27:21.512 01:01:28 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:21.513 01:01:28 -- nvmf/common.sh@296 -- # e810=() 00:27:21.513 01:01:28 -- nvmf/common.sh@296 -- # local -ga e810 00:27:21.513 01:01:28 -- nvmf/common.sh@297 -- # x722=() 00:27:21.513 01:01:28 -- nvmf/common.sh@297 -- # local -ga x722 00:27:21.513 01:01:28 -- nvmf/common.sh@298 -- # mlx=() 00:27:21.513 01:01:28 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:21.513 01:01:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:21.513 01:01:28 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:21.513 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:21.513 01:01:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:21.513 01:01:28 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:21.513 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:21.513 01:01:28 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:21.513 01:01:28 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.513 01:01:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.513 01:01:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:21.513 Found net devices under 0000:18:00.0: mlx_0_0 00:27:21.513 01:01:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.513 01:01:28 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.513 01:01:28 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:21.513 Found net devices under 0000:18:00.1: mlx_0_1 00:27:21.513 01:01:28 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.513 01:01:28 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:21.513 01:01:28 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:21.513 01:01:28 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:21.513 01:01:28 -- nvmf/common.sh@58 -- # uname 00:27:21.513 01:01:28 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:21.513 01:01:28 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:21.513 01:01:28 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:21.513 01:01:28 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:21.513 01:01:28 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:21.513 01:01:28 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:21.513 01:01:28 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:21.513 01:01:28 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:21.513 01:01:28 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:21.513 01:01:28 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:21.513 01:01:28 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:21.513 01:01:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:21.513 01:01:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:21.513 01:01:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:21.513 01:01:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:21.513 01:01:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:21.513 01:01:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:21.513 01:01:28 -- nvmf/common.sh@105 -- # continue 2 00:27:21.513 01:01:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.513 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:21.513 01:01:28 -- nvmf/common.sh@105 -- # continue 2 00:27:21.513 01:01:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:21.513 01:01:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:21.513 01:01:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:21.513 01:01:28 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:21.513 01:01:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:21.513 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:21.513 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:21.513 altname enp24s0f0np0 00:27:21.513 altname ens785f0np0 00:27:21.513 inet 192.168.100.8/24 scope global mlx_0_0 00:27:21.513 valid_lft forever preferred_lft forever 00:27:21.513 01:01:28 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:21.513 01:01:28 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:21.513 01:01:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:21.513 01:01:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:21.513 01:01:28 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:21.513 01:01:28 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:21.513 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:21.513 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:21.513 altname enp24s0f1np1 00:27:21.513 altname ens785f1np1 00:27:21.513 inet 192.168.100.9/24 scope global mlx_0_1 00:27:21.513 valid_lft forever preferred_lft forever 00:27:21.513 01:01:28 -- nvmf/common.sh@411 -- # return 0 00:27:21.513 01:01:28 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:21.513 01:01:28 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:21.513 01:01:28 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:21.513 01:01:28 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:21.513 01:01:28 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:21.513 01:01:28 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:21.513 01:01:28 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:21.513 01:01:28 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:21.513 01:01:28 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:21.772 01:01:28 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:21.772 01:01:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:21.772 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.772 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:21.772 01:01:28 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:21.772 01:01:28 -- nvmf/common.sh@105 -- # continue 2 00:27:21.772 01:01:28 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:21.772 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.772 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:21.772 01:01:28 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:21.772 01:01:28 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:21.772 01:01:28 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:21.772 01:01:28 -- nvmf/common.sh@105 -- # continue 2 00:27:21.772 01:01:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:21.772 01:01:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:21.772 01:01:28 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:21.772 01:01:28 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:21.772 01:01:28 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:21.772 01:01:28 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:21.772 01:01:28 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:21.772 01:01:28 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:21.772 192.168.100.9' 00:27:21.772 01:01:28 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:21.772 192.168.100.9' 00:27:21.772 01:01:28 -- nvmf/common.sh@446 -- # head -n 1 00:27:21.772 01:01:28 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:21.772 01:01:28 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:21.772 192.168.100.9' 00:27:21.772 01:01:28 -- nvmf/common.sh@447 -- # tail -n +2 00:27:21.772 01:01:28 -- nvmf/common.sh@447 -- # head -n 1 00:27:21.772 01:01:28 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:21.772 01:01:28 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:21.772 01:01:28 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:21.772 01:01:28 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:21.772 01:01:28 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:21.772 01:01:28 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:21.772 01:01:28 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:27:21.772 01:01:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:21.772 01:01:28 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:21.772 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:27:21.772 01:01:28 -- nvmf/common.sh@470 -- # nvmfpid=446806 00:27:21.772 01:01:28 -- nvmf/common.sh@471 -- # waitforlisten 446806 00:27:21.772 01:01:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:27:21.772 01:01:28 -- common/autotest_common.sh@817 -- # '[' -z 446806 ']' 00:27:21.772 01:01:28 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:21.772 01:01:28 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:21.772 01:01:28 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:21.772 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:21.772 01:01:28 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:21.772 01:01:28 -- common/autotest_common.sh@10 -- # set +x 00:27:21.772 [2024-04-26 01:01:28.831598] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:21.772 [2024-04-26 01:01:28.831639] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:21.772 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.772 [2024-04-26 01:01:28.880631] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.772 [2024-04-26 01:01:28.952407] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:21.772 [2024-04-26 01:01:28.952439] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:21.772 [2024-04-26 01:01:28.952446] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:21.772 [2024-04-26 01:01:28.952451] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:21.773 [2024-04-26 01:01:28.952456] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:21.773 [2024-04-26 01:01:28.952473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:22.709 01:01:29 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:22.709 01:01:29 -- common/autotest_common.sh@850 -- # return 0 00:27:22.709 01:01:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:22.709 01:01:29 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 01:01:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:22.709 01:01:29 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 [2024-04-26 01:01:29.659574] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a7e700/0x1a82bf0) succeed. 00:27:22.709 [2024-04-26 01:01:29.667651] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a7fc00/0x1ac4280) succeed. 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 null0 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g cae6b98ffb23420c921f6184346bf427 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 [2024-04-26 01:01:29.759662] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 nvme0n1 00:27:22.709 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.709 01:01:29 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:22.709 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.709 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 [ 00:27:22.709 { 00:27:22.709 "name": "nvme0n1", 00:27:22.709 "aliases": [ 00:27:22.709 "cae6b98f-fb23-420c-921f-6184346bf427" 00:27:22.709 ], 00:27:22.709 "product_name": "NVMe disk", 00:27:22.709 "block_size": 512, 00:27:22.709 "num_blocks": 2097152, 00:27:22.709 "uuid": "cae6b98f-fb23-420c-921f-6184346bf427", 00:27:22.709 "assigned_rate_limits": { 00:27:22.709 "rw_ios_per_sec": 0, 00:27:22.709 "rw_mbytes_per_sec": 0, 00:27:22.709 "r_mbytes_per_sec": 0, 00:27:22.709 "w_mbytes_per_sec": 0 00:27:22.709 }, 00:27:22.709 "claimed": false, 00:27:22.709 "zoned": false, 00:27:22.709 "supported_io_types": { 00:27:22.709 "read": true, 00:27:22.709 "write": true, 00:27:22.709 "unmap": false, 00:27:22.709 "write_zeroes": true, 00:27:22.709 "flush": true, 00:27:22.709 "reset": true, 00:27:22.709 "compare": true, 00:27:22.709 "compare_and_write": true, 00:27:22.709 "abort": true, 00:27:22.709 "nvme_admin": true, 00:27:22.709 "nvme_io": true 00:27:22.709 }, 00:27:22.709 "memory_domains": [ 00:27:22.709 { 00:27:22.709 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:22.709 "dma_device_type": 0 00:27:22.709 } 00:27:22.709 ], 00:27:22.709 "driver_specific": { 00:27:22.709 "nvme": [ 00:27:22.709 { 00:27:22.709 "trid": { 00:27:22.709 "trtype": "RDMA", 00:27:22.709 "adrfam": "IPv4", 00:27:22.709 "traddr": "192.168.100.8", 00:27:22.709 "trsvcid": "4420", 00:27:22.709 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:22.709 }, 00:27:22.709 "ctrlr_data": { 00:27:22.709 "cntlid": 1, 00:27:22.709 "vendor_id": "0x8086", 00:27:22.709 "model_number": "SPDK bdev Controller", 00:27:22.709 "serial_number": "00000000000000000000", 00:27:22.710 "firmware_revision": "24.05", 00:27:22.710 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:22.710 "oacs": { 00:27:22.710 "security": 0, 00:27:22.710 "format": 0, 00:27:22.710 "firmware": 0, 00:27:22.710 "ns_manage": 0 00:27:22.710 }, 00:27:22.710 "multi_ctrlr": true, 00:27:22.710 "ana_reporting": false 00:27:22.710 }, 00:27:22.710 "vs": { 00:27:22.710 "nvme_version": "1.3" 00:27:22.710 }, 00:27:22.710 "ns_data": { 00:27:22.710 "id": 1, 00:27:22.710 "can_share": true 00:27:22.710 } 00:27:22.710 } 00:27:22.710 ], 00:27:22.710 "mp_policy": "active_passive" 00:27:22.710 } 00:27:22.710 } 00:27:22.710 ] 00:27:22.710 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.710 01:01:29 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:27:22.710 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.710 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.710 [2024-04-26 01:01:29.859661] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:27:22.710 [2024-04-26 01:01:29.874268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:27:22.710 [2024-04-26 01:01:29.894326] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:22.710 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.710 01:01:29 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:22.710 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.710 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.969 [ 00:27:22.969 { 00:27:22.969 "name": "nvme0n1", 00:27:22.969 "aliases": [ 00:27:22.969 "cae6b98f-fb23-420c-921f-6184346bf427" 00:27:22.969 ], 00:27:22.969 "product_name": "NVMe disk", 00:27:22.969 "block_size": 512, 00:27:22.969 "num_blocks": 2097152, 00:27:22.969 "uuid": "cae6b98f-fb23-420c-921f-6184346bf427", 00:27:22.969 "assigned_rate_limits": { 00:27:22.969 "rw_ios_per_sec": 0, 00:27:22.969 "rw_mbytes_per_sec": 0, 00:27:22.969 "r_mbytes_per_sec": 0, 00:27:22.969 "w_mbytes_per_sec": 0 00:27:22.969 }, 00:27:22.969 "claimed": false, 00:27:22.969 "zoned": false, 00:27:22.969 "supported_io_types": { 00:27:22.969 "read": true, 00:27:22.969 "write": true, 00:27:22.969 "unmap": false, 00:27:22.969 "write_zeroes": true, 00:27:22.969 "flush": true, 00:27:22.969 "reset": true, 00:27:22.969 "compare": true, 00:27:22.969 "compare_and_write": true, 00:27:22.969 "abort": true, 00:27:22.969 "nvme_admin": true, 00:27:22.969 "nvme_io": true 00:27:22.969 }, 00:27:22.969 "memory_domains": [ 00:27:22.969 { 00:27:22.969 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:22.969 "dma_device_type": 0 00:27:22.969 } 00:27:22.969 ], 00:27:22.969 "driver_specific": { 00:27:22.969 "nvme": [ 00:27:22.969 { 00:27:22.969 "trid": { 00:27:22.969 "trtype": "RDMA", 00:27:22.969 "adrfam": "IPv4", 00:27:22.969 "traddr": "192.168.100.8", 00:27:22.969 "trsvcid": "4420", 00:27:22.969 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:22.969 }, 00:27:22.969 "ctrlr_data": { 00:27:22.969 "cntlid": 2, 00:27:22.969 "vendor_id": "0x8086", 00:27:22.969 "model_number": "SPDK bdev Controller", 00:27:22.969 "serial_number": "00000000000000000000", 00:27:22.969 "firmware_revision": "24.05", 00:27:22.969 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:22.969 "oacs": { 00:27:22.969 "security": 0, 00:27:22.969 "format": 0, 00:27:22.969 "firmware": 0, 00:27:22.969 "ns_manage": 0 00:27:22.969 }, 00:27:22.969 "multi_ctrlr": true, 00:27:22.969 "ana_reporting": false 00:27:22.969 }, 00:27:22.969 "vs": { 00:27:22.969 "nvme_version": "1.3" 00:27:22.969 }, 00:27:22.969 "ns_data": { 00:27:22.969 "id": 1, 00:27:22.969 "can_share": true 00:27:22.969 } 00:27:22.969 } 00:27:22.969 ], 00:27:22.969 "mp_policy": "active_passive" 00:27:22.969 } 00:27:22.969 } 00:27:22.969 ] 00:27:22.969 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.969 01:01:29 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:22.969 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.969 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.969 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.969 01:01:29 -- host/async_init.sh@53 -- # mktemp 00:27:22.969 01:01:29 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.Dajs6yqknO 00:27:22.969 01:01:29 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:27:22.969 01:01:29 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.Dajs6yqknO 00:27:22.969 01:01:29 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:27:22.969 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.969 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.969 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:29 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:27:22.970 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.970 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.970 [2024-04-26 01:01:29.968647] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:27:22.970 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:29 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Dajs6yqknO 00:27:22.970 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.970 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.970 01:01:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:29 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.Dajs6yqknO 00:27:22.970 01:01:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.970 01:01:29 -- common/autotest_common.sh@10 -- # set +x 00:27:22.970 [2024-04-26 01:01:29.984672] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:27:22.970 nvme0n1 00:27:22.970 01:01:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:30 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:27:22.970 01:01:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.970 01:01:30 -- common/autotest_common.sh@10 -- # set +x 00:27:22.970 [ 00:27:22.970 { 00:27:22.970 "name": "nvme0n1", 00:27:22.970 "aliases": [ 00:27:22.970 "cae6b98f-fb23-420c-921f-6184346bf427" 00:27:22.970 ], 00:27:22.970 "product_name": "NVMe disk", 00:27:22.970 "block_size": 512, 00:27:22.970 "num_blocks": 2097152, 00:27:22.970 "uuid": "cae6b98f-fb23-420c-921f-6184346bf427", 00:27:22.970 "assigned_rate_limits": { 00:27:22.970 "rw_ios_per_sec": 0, 00:27:22.970 "rw_mbytes_per_sec": 0, 00:27:22.970 "r_mbytes_per_sec": 0, 00:27:22.970 "w_mbytes_per_sec": 0 00:27:22.970 }, 00:27:22.970 "claimed": false, 00:27:22.970 "zoned": false, 00:27:22.970 "supported_io_types": { 00:27:22.970 "read": true, 00:27:22.970 "write": true, 00:27:22.970 "unmap": false, 00:27:22.970 "write_zeroes": true, 00:27:22.970 "flush": true, 00:27:22.970 "reset": true, 00:27:22.970 "compare": true, 00:27:22.970 "compare_and_write": true, 00:27:22.970 "abort": true, 00:27:22.970 "nvme_admin": true, 00:27:22.970 "nvme_io": true 00:27:22.970 }, 00:27:22.970 "memory_domains": [ 00:27:22.970 { 00:27:22.970 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:27:22.970 "dma_device_type": 0 00:27:22.970 } 00:27:22.970 ], 00:27:22.970 "driver_specific": { 00:27:22.970 "nvme": [ 00:27:22.970 { 00:27:22.970 "trid": { 00:27:22.970 "trtype": "RDMA", 00:27:22.970 "adrfam": "IPv4", 00:27:22.970 "traddr": "192.168.100.8", 00:27:22.970 "trsvcid": "4421", 00:27:22.970 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:27:22.970 }, 00:27:22.970 "ctrlr_data": { 00:27:22.970 "cntlid": 3, 00:27:22.970 "vendor_id": "0x8086", 00:27:22.970 "model_number": "SPDK bdev Controller", 00:27:22.970 "serial_number": "00000000000000000000", 00:27:22.970 "firmware_revision": "24.05", 00:27:22.970 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:22.970 "oacs": { 00:27:22.970 "security": 0, 00:27:22.970 "format": 0, 00:27:22.970 "firmware": 0, 00:27:22.970 "ns_manage": 0 00:27:22.970 }, 00:27:22.970 "multi_ctrlr": true, 00:27:22.970 "ana_reporting": false 00:27:22.970 }, 00:27:22.970 "vs": { 00:27:22.970 "nvme_version": "1.3" 00:27:22.970 }, 00:27:22.970 "ns_data": { 00:27:22.970 "id": 1, 00:27:22.970 "can_share": true 00:27:22.970 } 00:27:22.970 } 00:27:22.970 ], 00:27:22.970 "mp_policy": "active_passive" 00:27:22.970 } 00:27:22.970 } 00:27:22.970 ] 00:27:22.970 01:01:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:30 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:27:22.970 01:01:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:22.970 01:01:30 -- common/autotest_common.sh@10 -- # set +x 00:27:22.970 01:01:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:22.970 01:01:30 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.Dajs6yqknO 00:27:22.970 01:01:30 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:27:22.970 01:01:30 -- host/async_init.sh@78 -- # nvmftestfini 00:27:22.970 01:01:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:22.970 01:01:30 -- nvmf/common.sh@117 -- # sync 00:27:22.970 01:01:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:22.970 01:01:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:22.970 01:01:30 -- nvmf/common.sh@120 -- # set +e 00:27:22.970 01:01:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:22.970 01:01:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:22.970 rmmod nvme_rdma 00:27:22.970 rmmod nvme_fabrics 00:27:22.970 01:01:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:22.970 01:01:30 -- nvmf/common.sh@124 -- # set -e 00:27:22.970 01:01:30 -- nvmf/common.sh@125 -- # return 0 00:27:22.970 01:01:30 -- nvmf/common.sh@478 -- # '[' -n 446806 ']' 00:27:22.970 01:01:30 -- nvmf/common.sh@479 -- # killprocess 446806 00:27:22.970 01:01:30 -- common/autotest_common.sh@936 -- # '[' -z 446806 ']' 00:27:22.970 01:01:30 -- common/autotest_common.sh@940 -- # kill -0 446806 00:27:22.970 01:01:30 -- common/autotest_common.sh@941 -- # uname 00:27:22.970 01:01:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:23.230 01:01:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 446806 00:27:23.230 01:01:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:23.230 01:01:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:23.230 01:01:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 446806' 00:27:23.230 killing process with pid 446806 00:27:23.230 01:01:30 -- common/autotest_common.sh@955 -- # kill 446806 00:27:23.230 01:01:30 -- common/autotest_common.sh@960 -- # wait 446806 00:27:23.230 [2024-04-26 01:01:30.234832] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:23.489 01:01:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:23.489 01:01:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:23.489 00:27:23.489 real 0m7.286s 00:27:23.489 user 0m3.370s 00:27:23.489 sys 0m4.432s 00:27:23.489 01:01:30 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:23.489 01:01:30 -- common/autotest_common.sh@10 -- # set +x 00:27:23.489 ************************************ 00:27:23.489 END TEST nvmf_async_init 00:27:23.489 ************************************ 00:27:23.489 01:01:30 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:23.489 01:01:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:23.489 01:01:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:23.489 01:01:30 -- common/autotest_common.sh@10 -- # set +x 00:27:23.489 ************************************ 00:27:23.489 START TEST dma 00:27:23.489 ************************************ 00:27:23.489 01:01:30 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:27:23.489 * Looking for test storage... 00:27:23.748 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:23.748 01:01:30 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:23.748 01:01:30 -- nvmf/common.sh@7 -- # uname -s 00:27:23.748 01:01:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:23.748 01:01:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:23.748 01:01:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:23.748 01:01:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:23.748 01:01:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:23.748 01:01:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:23.748 01:01:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:23.748 01:01:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:23.748 01:01:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:23.748 01:01:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:23.748 01:01:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:23.748 01:01:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:23.748 01:01:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:23.748 01:01:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:23.748 01:01:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:23.748 01:01:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:23.748 01:01:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:23.748 01:01:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:23.748 01:01:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:23.748 01:01:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:23.748 01:01:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.748 01:01:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.748 01:01:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.748 01:01:30 -- paths/export.sh@5 -- # export PATH 00:27:23.748 01:01:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.748 01:01:30 -- nvmf/common.sh@47 -- # : 0 00:27:23.748 01:01:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:23.748 01:01:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:23.748 01:01:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:23.748 01:01:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:23.748 01:01:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:23.748 01:01:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:23.748 01:01:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:23.748 01:01:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:23.748 01:01:30 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:27:23.748 01:01:30 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:27:23.748 01:01:30 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:27:23.748 01:01:30 -- host/dma.sh@18 -- # subsystem=0 00:27:23.748 01:01:30 -- host/dma.sh@93 -- # nvmftestinit 00:27:23.748 01:01:30 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:23.748 01:01:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:23.748 01:01:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:23.748 01:01:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:23.748 01:01:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:23.748 01:01:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:23.748 01:01:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:23.748 01:01:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:23.748 01:01:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:23.748 01:01:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:23.748 01:01:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:23.748 01:01:30 -- common/autotest_common.sh@10 -- # set +x 00:27:29.038 01:01:35 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:29.038 01:01:35 -- nvmf/common.sh@291 -- # pci_devs=() 00:27:29.038 01:01:35 -- nvmf/common.sh@291 -- # local -a pci_devs 00:27:29.038 01:01:35 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:27:29.038 01:01:35 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:27:29.038 01:01:35 -- nvmf/common.sh@293 -- # pci_drivers=() 00:27:29.038 01:01:35 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:27:29.038 01:01:35 -- nvmf/common.sh@295 -- # net_devs=() 00:27:29.038 01:01:35 -- nvmf/common.sh@295 -- # local -ga net_devs 00:27:29.038 01:01:35 -- nvmf/common.sh@296 -- # e810=() 00:27:29.038 01:01:35 -- nvmf/common.sh@296 -- # local -ga e810 00:27:29.038 01:01:35 -- nvmf/common.sh@297 -- # x722=() 00:27:29.038 01:01:35 -- nvmf/common.sh@297 -- # local -ga x722 00:27:29.038 01:01:35 -- nvmf/common.sh@298 -- # mlx=() 00:27:29.038 01:01:35 -- nvmf/common.sh@298 -- # local -ga mlx 00:27:29.038 01:01:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:29.038 01:01:35 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:27:29.038 01:01:35 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:27:29.038 01:01:35 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:27:29.038 01:01:35 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:27:29.038 01:01:35 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:27:29.038 01:01:35 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:27:29.038 01:01:35 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:27:29.039 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:27:29.039 01:01:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:29.039 01:01:35 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:27:29.039 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:27:29.039 01:01:35 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:27:29.039 01:01:35 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:29.039 01:01:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:29.039 01:01:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:27:29.039 Found net devices under 0000:18:00.0: mlx_0_0 00:27:29.039 01:01:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:29.039 01:01:35 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:29.039 01:01:35 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:29.039 01:01:35 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:27:29.039 Found net devices under 0000:18:00.1: mlx_0_1 00:27:29.039 01:01:35 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:27:29.039 01:01:35 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@403 -- # is_hw=yes 00:27:29.039 01:01:35 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@409 -- # rdma_device_init 00:27:29.039 01:01:35 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:27:29.039 01:01:35 -- nvmf/common.sh@58 -- # uname 00:27:29.039 01:01:35 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:27:29.039 01:01:35 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:27:29.039 01:01:35 -- nvmf/common.sh@63 -- # modprobe ib_core 00:27:29.039 01:01:35 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:27:29.039 01:01:35 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:27:29.039 01:01:35 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:27:29.039 01:01:35 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:27:29.039 01:01:35 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:27:29.039 01:01:35 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:27:29.039 01:01:35 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:27:29.039 01:01:35 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:27:29.039 01:01:35 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:29.039 01:01:35 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:29.039 01:01:35 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:29.039 01:01:35 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:29.039 01:01:35 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:29.039 01:01:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:29.039 01:01:35 -- nvmf/common.sh@105 -- # continue 2 00:27:29.039 01:01:35 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:35 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:29.039 01:01:35 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:29.039 01:01:35 -- nvmf/common.sh@105 -- # continue 2 00:27:29.039 01:01:35 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:29.039 01:01:35 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:27:29.039 01:01:35 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:29.039 01:01:35 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:29.039 01:01:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:27:29.039 01:01:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:27:29.039 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:29.039 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:27:29.039 altname enp24s0f0np0 00:27:29.039 altname ens785f0np0 00:27:29.039 inet 192.168.100.8/24 scope global mlx_0_0 00:27:29.039 valid_lft forever preferred_lft forever 00:27:29.039 01:01:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:27:29.039 01:01:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:29.039 01:01:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:27:29.039 01:01:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:27:29.039 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:27:29.039 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:27:29.039 altname enp24s0f1np1 00:27:29.039 altname ens785f1np1 00:27:29.039 inet 192.168.100.9/24 scope global mlx_0_1 00:27:29.039 valid_lft forever preferred_lft forever 00:27:29.039 01:01:36 -- nvmf/common.sh@411 -- # return 0 00:27:29.039 01:01:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:27:29.039 01:01:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:27:29.039 01:01:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:27:29.039 01:01:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:27:29.039 01:01:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:27:29.039 01:01:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:27:29.039 01:01:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:27:29.039 01:01:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:27:29.039 01:01:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:27:29.039 01:01:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:29.039 01:01:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:27:29.039 01:01:36 -- nvmf/common.sh@105 -- # continue 2 00:27:29.039 01:01:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:27:29.039 01:01:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:27:29.039 01:01:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:27:29.039 01:01:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@105 -- # continue 2 00:27:29.039 01:01:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:29.039 01:01:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:27:29.039 01:01:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:29.039 01:01:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:27:29.039 01:01:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:27:29.039 01:01:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:27:29.039 01:01:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:27:29.039 192.168.100.9' 00:27:29.039 01:01:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:27:29.039 192.168.100.9' 00:27:29.039 01:01:36 -- nvmf/common.sh@446 -- # head -n 1 00:27:29.039 01:01:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:27:29.039 01:01:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:27:29.039 192.168.100.9' 00:27:29.040 01:01:36 -- nvmf/common.sh@447 -- # tail -n +2 00:27:29.040 01:01:36 -- nvmf/common.sh@447 -- # head -n 1 00:27:29.040 01:01:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:27:29.040 01:01:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:27:29.040 01:01:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:27:29.040 01:01:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:27:29.040 01:01:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:27:29.040 01:01:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:27:29.040 01:01:36 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:27:29.040 01:01:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:27:29.040 01:01:36 -- common/autotest_common.sh@710 -- # xtrace_disable 00:27:29.040 01:01:36 -- common/autotest_common.sh@10 -- # set +x 00:27:29.040 01:01:36 -- nvmf/common.sh@470 -- # nvmfpid=450326 00:27:29.040 01:01:36 -- nvmf/common.sh@471 -- # waitforlisten 450326 00:27:29.040 01:01:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:27:29.040 01:01:36 -- common/autotest_common.sh@817 -- # '[' -z 450326 ']' 00:27:29.040 01:01:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:29.040 01:01:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:27:29.040 01:01:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:29.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:29.040 01:01:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:27:29.040 01:01:36 -- common/autotest_common.sh@10 -- # set +x 00:27:29.040 [2024-04-26 01:01:36.167593] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:29.040 [2024-04-26 01:01:36.167646] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:29.040 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.040 [2024-04-26 01:01:36.219727] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:29.299 [2024-04-26 01:01:36.295348] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:29.299 [2024-04-26 01:01:36.295384] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:29.299 [2024-04-26 01:01:36.295391] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:27:29.299 [2024-04-26 01:01:36.295396] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:27:29.299 [2024-04-26 01:01:36.295401] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:29.299 [2024-04-26 01:01:36.295456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:29.299 [2024-04-26 01:01:36.295458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:29.867 01:01:36 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:27:29.867 01:01:36 -- common/autotest_common.sh@850 -- # return 0 00:27:29.867 01:01:36 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:27:29.867 01:01:36 -- common/autotest_common.sh@716 -- # xtrace_disable 00:27:29.867 01:01:36 -- common/autotest_common.sh@10 -- # set +x 00:27:29.867 01:01:36 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.867 01:01:36 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:27:29.867 01:01:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:29.867 01:01:36 -- common/autotest_common.sh@10 -- # set +x 00:27:29.867 [2024-04-26 01:01:37.004311] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x143f2b0/0x14437a0) succeed. 00:27:29.867 [2024-04-26 01:01:37.012400] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14407b0/0x1484e30) succeed. 00:27:30.126 01:01:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.126 01:01:37 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:27:30.126 01:01:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.126 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:27:30.126 Malloc0 00:27:30.126 01:01:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.126 01:01:37 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:27:30.126 01:01:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.126 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:27:30.126 01:01:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.126 01:01:37 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:27:30.126 01:01:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.126 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:27:30.126 01:01:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.126 01:01:37 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:27:30.126 01:01:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:27:30.126 01:01:37 -- common/autotest_common.sh@10 -- # set +x 00:27:30.126 [2024-04-26 01:01:37.152705] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:27:30.126 01:01:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:27:30.126 01:01:37 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:27:30.126 01:01:37 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:27:30.126 01:01:37 -- nvmf/common.sh@521 -- # config=() 00:27:30.126 01:01:37 -- nvmf/common.sh@521 -- # local subsystem config 00:27:30.126 01:01:37 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:27:30.126 01:01:37 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:27:30.126 { 00:27:30.126 "params": { 00:27:30.126 "name": "Nvme$subsystem", 00:27:30.126 "trtype": "$TEST_TRANSPORT", 00:27:30.126 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:30.126 "adrfam": "ipv4", 00:27:30.126 "trsvcid": "$NVMF_PORT", 00:27:30.126 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:30.126 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:30.126 "hdgst": ${hdgst:-false}, 00:27:30.126 "ddgst": ${ddgst:-false} 00:27:30.126 }, 00:27:30.126 "method": "bdev_nvme_attach_controller" 00:27:30.126 } 00:27:30.126 EOF 00:27:30.126 )") 00:27:30.126 01:01:37 -- nvmf/common.sh@543 -- # cat 00:27:30.126 01:01:37 -- nvmf/common.sh@545 -- # jq . 00:27:30.126 01:01:37 -- nvmf/common.sh@546 -- # IFS=, 00:27:30.126 01:01:37 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:27:30.126 "params": { 00:27:30.126 "name": "Nvme0", 00:27:30.126 "trtype": "rdma", 00:27:30.126 "traddr": "192.168.100.8", 00:27:30.126 "adrfam": "ipv4", 00:27:30.126 "trsvcid": "4420", 00:27:30.126 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:27:30.126 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:27:30.126 "hdgst": false, 00:27:30.126 "ddgst": false 00:27:30.126 }, 00:27:30.126 "method": "bdev_nvme_attach_controller" 00:27:30.126 }' 00:27:30.126 [2024-04-26 01:01:37.195203] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:30.126 [2024-04-26 01:01:37.195257] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid450607 ] 00:27:30.126 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.126 [2024-04-26 01:01:37.241883] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:30.126 [2024-04-26 01:01:37.308998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:30.126 [2024-04-26 01:01:37.309001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:36.695 bdev Nvme0n1 reports 1 memory domains 00:27:36.695 bdev Nvme0n1 supports RDMA memory domain 00:27:36.695 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:36.695 ========================================================================== 00:27:36.695 Latency [us] 00:27:36.695 IOPS MiB/s Average min max 00:27:36.695 Core 2: 23224.61 90.72 688.28 238.02 8524.70 00:27:36.695 Core 3: 23308.00 91.05 685.77 221.36 8471.75 00:27:36.695 ========================================================================== 00:27:36.695 Total : 46532.62 181.77 687.02 221.36 8524.70 00:27:36.695 00:27:36.695 Total operations: 232701, translate 232701 pull_push 0 memzero 0 00:27:36.695 01:01:42 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:27:36.695 01:01:42 -- host/dma.sh@107 -- # gen_malloc_json 00:27:36.695 01:01:42 -- host/dma.sh@21 -- # jq . 00:27:36.695 [2024-04-26 01:01:42.753155] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:36.695 [2024-04-26 01:01:42.753200] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid451479 ] 00:27:36.695 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.695 [2024-04-26 01:01:42.799583] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:36.695 [2024-04-26 01:01:42.865952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:36.695 [2024-04-26 01:01:42.865955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:41.965 bdev Malloc0 reports 2 memory domains 00:27:41.965 bdev Malloc0 doesn't support RDMA memory domain 00:27:41.965 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:41.965 ========================================================================== 00:27:41.965 Latency [us] 00:27:41.965 IOPS MiB/s Average min max 00:27:41.965 Core 2: 15501.75 60.55 1031.46 377.47 1305.07 00:27:41.965 Core 3: 15742.07 61.49 1015.69 416.16 1670.71 00:27:41.965 ========================================================================== 00:27:41.965 Total : 31243.81 122.05 1023.51 377.47 1670.71 00:27:41.965 00:27:41.965 Total operations: 156274, translate 0 pull_push 625096 memzero 0 00:27:41.965 01:01:48 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:27:41.965 01:01:48 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:27:41.965 01:01:48 -- host/dma.sh@48 -- # local subsystem=0 00:27:41.965 01:01:48 -- host/dma.sh@50 -- # jq . 00:27:41.965 Ignoring -M option 00:27:41.965 [2024-04-26 01:01:48.225210] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:41.965 [2024-04-26 01:01:48.225268] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid452451 ] 00:27:41.965 EAL: No free 2048 kB hugepages reported on node 1 00:27:41.965 [2024-04-26 01:01:48.272328] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:41.965 [2024-04-26 01:01:48.335119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:41.965 [2024-04-26 01:01:48.335121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:41.965 [2024-04-26 01:01:48.539914] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:47.236 [2024-04-26 01:01:53.567404] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:47.236 bdev 82b30b77-1d02-4410-a695-06de2a40fd3c reports 1 memory domains 00:27:47.236 bdev 82b30b77-1d02-4410-a695-06de2a40fd3c supports RDMA memory domain 00:27:47.236 Initialization complete, running randread IO for 5 sec on 2 cores 00:27:47.236 ========================================================================== 00:27:47.236 Latency [us] 00:27:47.236 IOPS MiB/s Average min max 00:27:47.236 Core 2: 89664.45 350.25 177.79 70.68 2680.48 00:27:47.236 Core 3: 90463.97 353.37 176.21 70.03 2613.41 00:27:47.236 ========================================================================== 00:27:47.236 Total : 180128.43 703.63 177.00 70.03 2680.48 00:27:47.236 00:27:47.236 Total operations: 900734, translate 0 pull_push 0 memzero 900734 00:27:47.236 01:01:53 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:27:47.236 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.236 [2024-04-26 01:01:53.877406] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:27:49.141 Initializing NVMe Controllers 00:27:49.141 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:27:49.141 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:27:49.141 Initialization complete. Launching workers. 00:27:49.141 ======================================================== 00:27:49.141 Latency(us) 00:27:49.141 Device Information : IOPS MiB/s Average min max 00:27:49.141 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2016.00 7.88 7980.54 7955.75 7996.11 00:27:49.141 ======================================================== 00:27:49.141 Total : 2016.00 7.88 7980.54 7955.75 7996.11 00:27:49.141 00:27:49.141 01:01:56 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:27:49.141 01:01:56 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:27:49.141 01:01:56 -- host/dma.sh@48 -- # local subsystem=0 00:27:49.141 01:01:56 -- host/dma.sh@50 -- # jq . 00:27:49.141 [2024-04-26 01:01:56.205156] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:27:49.141 [2024-04-26 01:01:56.205200] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid453828 ] 00:27:49.141 EAL: No free 2048 kB hugepages reported on node 1 00:27:49.141 [2024-04-26 01:01:56.252873] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:49.141 [2024-04-26 01:01:56.320298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:49.141 [2024-04-26 01:01:56.320300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:49.400 [2024-04-26 01:01:56.514391] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:27:54.674 [2024-04-26 01:02:01.543138] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:27:54.674 bdev 987be89b-bf52-43f4-8387-6301ec0661a4 reports 1 memory domains 00:27:54.674 bdev 987be89b-bf52-43f4-8387-6301ec0661a4 supports RDMA memory domain 00:27:54.674 Initialization complete, running randrw IO for 5 sec on 2 cores 00:27:54.674 ========================================================================== 00:27:54.674 Latency [us] 00:27:54.674 IOPS MiB/s Average min max 00:27:54.674 Core 2: 20608.26 80.50 775.55 24.50 11978.48 00:27:54.674 Core 3: 20896.76 81.63 764.90 11.10 11725.72 00:27:54.674 ========================================================================== 00:27:54.674 Total : 41505.02 162.13 770.19 11.10 11978.48 00:27:54.674 00:27:54.674 Total operations: 207599, translate 207496 pull_push 0 memzero 103 00:27:54.674 01:02:01 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:27:54.675 01:02:01 -- host/dma.sh@120 -- # nvmftestfini 00:27:54.675 01:02:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:27:54.675 01:02:01 -- nvmf/common.sh@117 -- # sync 00:27:54.675 01:02:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:27:54.675 01:02:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:27:54.675 01:02:01 -- nvmf/common.sh@120 -- # set +e 00:27:54.675 01:02:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:27:54.675 01:02:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:27:54.675 rmmod nvme_rdma 00:27:54.675 rmmod nvme_fabrics 00:27:54.675 01:02:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:27:54.675 01:02:01 -- nvmf/common.sh@124 -- # set -e 00:27:54.675 01:02:01 -- nvmf/common.sh@125 -- # return 0 00:27:54.675 01:02:01 -- nvmf/common.sh@478 -- # '[' -n 450326 ']' 00:27:54.675 01:02:01 -- nvmf/common.sh@479 -- # killprocess 450326 00:27:54.675 01:02:01 -- common/autotest_common.sh@936 -- # '[' -z 450326 ']' 00:27:54.675 01:02:01 -- common/autotest_common.sh@940 -- # kill -0 450326 00:27:54.675 01:02:01 -- common/autotest_common.sh@941 -- # uname 00:27:54.675 01:02:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:54.675 01:02:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 450326 00:27:54.675 01:02:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:54.675 01:02:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:54.675 01:02:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 450326' 00:27:54.675 killing process with pid 450326 00:27:54.675 01:02:01 -- common/autotest_common.sh@955 -- # kill 450326 00:27:54.675 01:02:01 -- common/autotest_common.sh@960 -- # wait 450326 00:27:54.934 [2024-04-26 01:02:01.893034] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:27:55.193 01:02:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:27:55.193 01:02:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:27:55.193 00:27:55.193 real 0m31.565s 00:27:55.193 user 1m36.070s 00:27:55.193 sys 0m5.066s 00:27:55.193 01:02:02 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:27:55.193 01:02:02 -- common/autotest_common.sh@10 -- # set +x 00:27:55.193 ************************************ 00:27:55.193 END TEST dma 00:27:55.193 ************************************ 00:27:55.193 01:02:02 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:55.193 01:02:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:55.193 01:02:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:55.193 01:02:02 -- common/autotest_common.sh@10 -- # set +x 00:27:55.193 ************************************ 00:27:55.193 START TEST nvmf_identify 00:27:55.193 ************************************ 00:27:55.193 01:02:02 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:27:55.453 * Looking for test storage... 00:27:55.453 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:27:55.453 01:02:02 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:27:55.453 01:02:02 -- nvmf/common.sh@7 -- # uname -s 00:27:55.453 01:02:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:55.453 01:02:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:55.453 01:02:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:55.453 01:02:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:55.453 01:02:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:55.453 01:02:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:55.453 01:02:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:55.453 01:02:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:55.453 01:02:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:55.453 01:02:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:55.453 01:02:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:27:55.453 01:02:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:27:55.453 01:02:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:55.453 01:02:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:55.453 01:02:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:55.453 01:02:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:27:55.453 01:02:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:27:55.453 01:02:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:55.453 01:02:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:55.453 01:02:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:55.453 01:02:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.453 01:02:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.453 01:02:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.453 01:02:02 -- paths/export.sh@5 -- # export PATH 00:27:55.453 01:02:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:55.453 01:02:02 -- nvmf/common.sh@47 -- # : 0 00:27:55.453 01:02:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:27:55.453 01:02:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:27:55.453 01:02:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:27:55.453 01:02:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:55.453 01:02:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:55.453 01:02:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:27:55.453 01:02:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:27:55.453 01:02:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:27:55.453 01:02:02 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:55.453 01:02:02 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:55.453 01:02:02 -- host/identify.sh@14 -- # nvmftestinit 00:27:55.453 01:02:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:27:55.453 01:02:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:55.453 01:02:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:27:55.453 01:02:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:27:55.453 01:02:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:27:55.453 01:02:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.453 01:02:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.453 01:02:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:55.453 01:02:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:27:55.453 01:02:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:27:55.453 01:02:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:27:55.453 01:02:02 -- common/autotest_common.sh@10 -- # set +x 00:28:00.738 01:02:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:00.738 01:02:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:00.738 01:02:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:00.739 01:02:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:00.739 01:02:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:00.739 01:02:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:00.739 01:02:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:00.739 01:02:07 -- nvmf/common.sh@295 -- # net_devs=() 00:28:00.739 01:02:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:00.739 01:02:07 -- nvmf/common.sh@296 -- # e810=() 00:28:00.739 01:02:07 -- nvmf/common.sh@296 -- # local -ga e810 00:28:00.739 01:02:07 -- nvmf/common.sh@297 -- # x722=() 00:28:00.739 01:02:07 -- nvmf/common.sh@297 -- # local -ga x722 00:28:00.739 01:02:07 -- nvmf/common.sh@298 -- # mlx=() 00:28:00.739 01:02:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:00.739 01:02:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:00.739 01:02:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:28:00.739 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:28:00.739 01:02:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:00.739 01:02:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:28:00.739 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:28:00.739 01:02:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:00.739 01:02:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.739 01:02:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.739 01:02:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:28:00.739 Found net devices under 0000:18:00.0: mlx_0_0 00:28:00.739 01:02:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.739 01:02:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.739 01:02:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:28:00.739 Found net devices under 0000:18:00.1: mlx_0_1 00:28:00.739 01:02:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.739 01:02:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:00.739 01:02:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:28:00.739 01:02:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:28:00.739 01:02:07 -- nvmf/common.sh@58 -- # uname 00:28:00.739 01:02:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:28:00.739 01:02:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:28:00.739 01:02:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:28:00.739 01:02:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:28:00.739 01:02:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:28:00.739 01:02:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:28:00.739 01:02:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:28:00.739 01:02:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:28:00.739 01:02:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:28:00.739 01:02:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:28:00.739 01:02:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:28:00.739 01:02:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:00.739 01:02:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:00.739 01:02:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:00.739 01:02:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:00.739 01:02:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:00.739 01:02:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:28:00.739 01:02:07 -- nvmf/common.sh@105 -- # continue 2 00:28:00.739 01:02:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.739 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:28:00.739 01:02:07 -- nvmf/common.sh@105 -- # continue 2 00:28:00.739 01:02:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:00.739 01:02:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:28:00.739 01:02:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:00.739 01:02:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:28:00.739 01:02:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:28:00.739 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:28:00.739 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:28:00.739 altname enp24s0f0np0 00:28:00.739 altname ens785f0np0 00:28:00.739 inet 192.168.100.8/24 scope global mlx_0_0 00:28:00.739 valid_lft forever preferred_lft forever 00:28:00.739 01:02:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:00.739 01:02:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:28:00.739 01:02:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:00.739 01:02:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:00.739 01:02:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:28:00.739 01:02:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:28:00.739 01:02:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:28:00.739 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:28:00.739 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:28:00.739 altname enp24s0f1np1 00:28:00.739 altname ens785f1np1 00:28:00.739 inet 192.168.100.9/24 scope global mlx_0_1 00:28:00.739 valid_lft forever preferred_lft forever 00:28:00.739 01:02:07 -- nvmf/common.sh@411 -- # return 0 00:28:00.739 01:02:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:00.739 01:02:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:28:00.739 01:02:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:28:00.740 01:02:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:28:00.740 01:02:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:28:00.740 01:02:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:00.740 01:02:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:00.740 01:02:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:00.740 01:02:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:00.740 01:02:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:00.740 01:02:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:00.740 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.740 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:28:00.740 01:02:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:28:00.740 01:02:07 -- nvmf/common.sh@105 -- # continue 2 00:28:00.740 01:02:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:00.740 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.740 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:28:00.740 01:02:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:00.740 01:02:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:28:00.740 01:02:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:28:00.740 01:02:07 -- nvmf/common.sh@105 -- # continue 2 00:28:00.740 01:02:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:00.740 01:02:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:28:00.740 01:02:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:00.740 01:02:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:00.740 01:02:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:28:00.740 01:02:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:00.740 01:02:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:00.740 01:02:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:28:00.740 192.168.100.9' 00:28:00.740 01:02:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:28:00.740 192.168.100.9' 00:28:00.740 01:02:07 -- nvmf/common.sh@446 -- # head -n 1 00:28:00.740 01:02:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:28:00.740 01:02:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:28:00.740 192.168.100.9' 00:28:00.740 01:02:07 -- nvmf/common.sh@447 -- # head -n 1 00:28:00.740 01:02:07 -- nvmf/common.sh@447 -- # tail -n +2 00:28:00.740 01:02:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:28:00.740 01:02:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:28:00.740 01:02:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:28:00.740 01:02:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:28:00.740 01:02:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:28:00.740 01:02:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:28:00.740 01:02:07 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:28:00.740 01:02:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:00.740 01:02:07 -- common/autotest_common.sh@10 -- # set +x 00:28:00.740 01:02:07 -- host/identify.sh@19 -- # nvmfpid=458050 00:28:00.740 01:02:07 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:00.740 01:02:07 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:00.740 01:02:07 -- host/identify.sh@23 -- # waitforlisten 458050 00:28:00.740 01:02:07 -- common/autotest_common.sh@817 -- # '[' -z 458050 ']' 00:28:00.740 01:02:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:00.740 01:02:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:00.740 01:02:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:00.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:00.740 01:02:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:00.740 01:02:07 -- common/autotest_common.sh@10 -- # set +x 00:28:00.740 [2024-04-26 01:02:07.567132] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:28:00.740 [2024-04-26 01:02:07.567183] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:00.740 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.740 [2024-04-26 01:02:07.618168] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:00.740 [2024-04-26 01:02:07.689628] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:00.740 [2024-04-26 01:02:07.689669] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:00.740 [2024-04-26 01:02:07.689675] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:28:00.740 [2024-04-26 01:02:07.689680] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:28:00.740 [2024-04-26 01:02:07.689686] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:00.740 [2024-04-26 01:02:07.689742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:00.740 [2024-04-26 01:02:07.689834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:00.740 [2024-04-26 01:02:07.689898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:00.740 [2024-04-26 01:02:07.689900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:01.309 01:02:08 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:01.309 01:02:08 -- common/autotest_common.sh@850 -- # return 0 00:28:01.309 01:02:08 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:28:01.309 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.309 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.309 [2024-04-26 01:02:08.382198] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xce5880/0xce9d70) succeed. 00:28:01.309 [2024-04-26 01:02:08.391503] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xce6ec0/0xd2b400) succeed. 00:28:01.309 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.309 01:02:08 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:28:01.309 01:02:08 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:01.309 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 01:02:08 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 Malloc0 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 [2024-04-26 01:02:08.584891] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:28:01.576 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.576 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.576 [2024-04-26 01:02:08.600620] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:01.576 [ 00:28:01.576 { 00:28:01.576 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:01.576 "subtype": "Discovery", 00:28:01.576 "listen_addresses": [ 00:28:01.576 { 00:28:01.576 "transport": "RDMA", 00:28:01.576 "trtype": "RDMA", 00:28:01.576 "adrfam": "IPv4", 00:28:01.576 "traddr": "192.168.100.8", 00:28:01.576 "trsvcid": "4420" 00:28:01.576 } 00:28:01.576 ], 00:28:01.576 "allow_any_host": true, 00:28:01.576 "hosts": [] 00:28:01.576 }, 00:28:01.576 { 00:28:01.576 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:01.576 "subtype": "NVMe", 00:28:01.576 "listen_addresses": [ 00:28:01.576 { 00:28:01.576 "transport": "RDMA", 00:28:01.576 "trtype": "RDMA", 00:28:01.576 "adrfam": "IPv4", 00:28:01.576 "traddr": "192.168.100.8", 00:28:01.576 "trsvcid": "4420" 00:28:01.576 } 00:28:01.576 ], 00:28:01.576 "allow_any_host": true, 00:28:01.576 "hosts": [], 00:28:01.576 "serial_number": "SPDK00000000000001", 00:28:01.576 "model_number": "SPDK bdev Controller", 00:28:01.576 "max_namespaces": 32, 00:28:01.576 "min_cntlid": 1, 00:28:01.576 "max_cntlid": 65519, 00:28:01.576 "namespaces": [ 00:28:01.576 { 00:28:01.576 "nsid": 1, 00:28:01.576 "bdev_name": "Malloc0", 00:28:01.576 "name": "Malloc0", 00:28:01.576 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:28:01.576 "eui64": "ABCDEF0123456789", 00:28:01.576 "uuid": "06bd0118-5b69-41c0-89bb-7bc820679835" 00:28:01.576 } 00:28:01.576 ] 00:28:01.576 } 00:28:01.576 ] 00:28:01.576 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.576 01:02:08 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:28:01.576 [2024-04-26 01:02:08.636149] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:28:01.576 [2024-04-26 01:02:08.636192] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid458330 ] 00:28:01.576 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.576 [2024-04-26 01:02:08.676428] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:28:01.576 [2024-04-26 01:02:08.676497] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:28:01.576 [2024-04-26 01:02:08.676513] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:28:01.576 [2024-04-26 01:02:08.676516] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:28:01.576 [2024-04-26 01:02:08.676540] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:28:01.576 [2024-04-26 01:02:08.687527] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:28:01.576 [2024-04-26 01:02:08.701199] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:28:01.576 [2024-04-26 01:02:08.701208] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:28:01.576 [2024-04-26 01:02:08.701214] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701219] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701223] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701227] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701231] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701235] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701241] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701245] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701249] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701253] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701257] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701261] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701265] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701269] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701273] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701276] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701281] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701284] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701289] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701292] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701296] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701300] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701304] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701308] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.576 [2024-04-26 01:02:08.701312] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701318] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701322] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701326] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701330] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701334] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701338] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701341] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:28:01.577 [2024-04-26 01:02:08.701346] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:28:01.577 [2024-04-26 01:02:08.701348] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:28:01.577 [2024-04-26 01:02:08.701365] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.701376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183600 00:28:01.577 [2024-04-26 01:02:08.707245] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707259] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707264] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:28:01.577 [2024-04-26 01:02:08.707270] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707274] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707288] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707317] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707328] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707332] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707336] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707342] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707347] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707365] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707373] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707376] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707383] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707388] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707393] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707413] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707422] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707425] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707431] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707437] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707454] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707462] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:28:01.577 [2024-04-26 01:02:08.707465] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707469] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707473] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707578] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:28:01.577 [2024-04-26 01:02:08.707582] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707588] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707610] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707618] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:28:01.577 [2024-04-26 01:02:08.707621] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707627] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707632] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707649] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707657] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:28:01.577 [2024-04-26 01:02:08.707662] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:28:01.577 [2024-04-26 01:02:08.707666] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707670] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:28:01.577 [2024-04-26 01:02:08.707679] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:28:01.577 [2024-04-26 01:02:08.707687] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707692] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183600 00:28:01.577 [2024-04-26 01:02:08.707728] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:28:01.577 [2024-04-26 01:02:08.707738] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:28:01.577 [2024-04-26 01:02:08.707742] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:28:01.577 [2024-04-26 01:02:08.707746] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:28:01.577 [2024-04-26 01:02:08.707752] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:28:01.577 [2024-04-26 01:02:08.707756] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:28:01.577 [2024-04-26 01:02:08.707760] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:28:01.577 [2024-04-26 01:02:08.707763] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707768] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:28:01.577 [2024-04-26 01:02:08.707774] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.577 [2024-04-26 01:02:08.707779] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.577 [2024-04-26 01:02:08.707796] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.577 [2024-04-26 01:02:08.707800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.707807] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.578 [2024-04-26 01:02:08.707816] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707821] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.578 [2024-04-26 01:02:08.707826] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707830] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.578 [2024-04-26 01:02:08.707836] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707841] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.578 [2024-04-26 01:02:08.707844] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:28:01.578 [2024-04-26 01:02:08.707848] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707856] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:28:01.578 [2024-04-26 01:02:08.707861] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707866] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.578 [2024-04-26 01:02:08.707886] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.707890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.707895] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:28:01.578 [2024-04-26 01:02:08.707899] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:28:01.578 [2024-04-26 01:02:08.707903] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707909] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707915] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183600 00:28:01.578 [2024-04-26 01:02:08.707938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.707942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.707947] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707954] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:28:01.578 [2024-04-26 01:02:08.707968] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x183600 00:28:01.578 [2024-04-26 01:02:08.707979] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.707984] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.578 [2024-04-26 01:02:08.708001] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.708005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.708013] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.708018] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x183600 00:28:01.578 [2024-04-26 01:02:08.708022] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.708028] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.708032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.708035] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.708051] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.708055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.708062] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.708067] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x183600 00:28:01.578 [2024-04-26 01:02:08.708071] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.578 [2024-04-26 01:02:08.708092] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.578 [2024-04-26 01:02:08.708096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:28:01.578 [2024-04-26 01:02:08.708103] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.578 ===================================================== 00:28:01.578 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:28:01.578 ===================================================== 00:28:01.578 Controller Capabilities/Features 00:28:01.578 ================================ 00:28:01.578 Vendor ID: 0000 00:28:01.578 Subsystem Vendor ID: 0000 00:28:01.578 Serial Number: .................... 00:28:01.578 Model Number: ........................................ 00:28:01.578 Firmware Version: 24.05 00:28:01.578 Recommended Arb Burst: 0 00:28:01.578 IEEE OUI Identifier: 00 00 00 00:28:01.578 Multi-path I/O 00:28:01.578 May have multiple subsystem ports: No 00:28:01.578 May have multiple controllers: No 00:28:01.578 Associated with SR-IOV VF: No 00:28:01.578 Max Data Transfer Size: 131072 00:28:01.578 Max Number of Namespaces: 0 00:28:01.578 Max Number of I/O Queues: 1024 00:28:01.578 NVMe Specification Version (VS): 1.3 00:28:01.578 NVMe Specification Version (Identify): 1.3 00:28:01.578 Maximum Queue Entries: 128 00:28:01.578 Contiguous Queues Required: Yes 00:28:01.578 Arbitration Mechanisms Supported 00:28:01.578 Weighted Round Robin: Not Supported 00:28:01.578 Vendor Specific: Not Supported 00:28:01.578 Reset Timeout: 15000 ms 00:28:01.578 Doorbell Stride: 4 bytes 00:28:01.578 NVM Subsystem Reset: Not Supported 00:28:01.578 Command Sets Supported 00:28:01.578 NVM Command Set: Supported 00:28:01.578 Boot Partition: Not Supported 00:28:01.578 Memory Page Size Minimum: 4096 bytes 00:28:01.578 Memory Page Size Maximum: 4096 bytes 00:28:01.578 Persistent Memory Region: Not Supported 00:28:01.578 Optional Asynchronous Events Supported 00:28:01.578 Namespace Attribute Notices: Not Supported 00:28:01.578 Firmware Activation Notices: Not Supported 00:28:01.578 ANA Change Notices: Not Supported 00:28:01.578 PLE Aggregate Log Change Notices: Not Supported 00:28:01.578 LBA Status Info Alert Notices: Not Supported 00:28:01.578 EGE Aggregate Log Change Notices: Not Supported 00:28:01.578 Normal NVM Subsystem Shutdown event: Not Supported 00:28:01.578 Zone Descriptor Change Notices: Not Supported 00:28:01.578 Discovery Log Change Notices: Supported 00:28:01.578 Controller Attributes 00:28:01.578 128-bit Host Identifier: Not Supported 00:28:01.578 Non-Operational Permissive Mode: Not Supported 00:28:01.578 NVM Sets: Not Supported 00:28:01.578 Read Recovery Levels: Not Supported 00:28:01.578 Endurance Groups: Not Supported 00:28:01.578 Predictable Latency Mode: Not Supported 00:28:01.578 Traffic Based Keep ALive: Not Supported 00:28:01.578 Namespace Granularity: Not Supported 00:28:01.578 SQ Associations: Not Supported 00:28:01.578 UUID List: Not Supported 00:28:01.578 Multi-Domain Subsystem: Not Supported 00:28:01.578 Fixed Capacity Management: Not Supported 00:28:01.578 Variable Capacity Management: Not Supported 00:28:01.578 Delete Endurance Group: Not Supported 00:28:01.578 Delete NVM Set: Not Supported 00:28:01.578 Extended LBA Formats Supported: Not Supported 00:28:01.578 Flexible Data Placement Supported: Not Supported 00:28:01.578 00:28:01.579 Controller Memory Buffer Support 00:28:01.579 ================================ 00:28:01.579 Supported: No 00:28:01.579 00:28:01.579 Persistent Memory Region Support 00:28:01.579 ================================ 00:28:01.579 Supported: No 00:28:01.579 00:28:01.579 Admin Command Set Attributes 00:28:01.579 ============================ 00:28:01.579 Security Send/Receive: Not Supported 00:28:01.579 Format NVM: Not Supported 00:28:01.579 Firmware Activate/Download: Not Supported 00:28:01.579 Namespace Management: Not Supported 00:28:01.579 Device Self-Test: Not Supported 00:28:01.579 Directives: Not Supported 00:28:01.579 NVMe-MI: Not Supported 00:28:01.579 Virtualization Management: Not Supported 00:28:01.579 Doorbell Buffer Config: Not Supported 00:28:01.579 Get LBA Status Capability: Not Supported 00:28:01.579 Command & Feature Lockdown Capability: Not Supported 00:28:01.579 Abort Command Limit: 1 00:28:01.579 Async Event Request Limit: 4 00:28:01.579 Number of Firmware Slots: N/A 00:28:01.579 Firmware Slot 1 Read-Only: N/A 00:28:01.579 Firmware Activation Without Reset: N/A 00:28:01.579 Multiple Update Detection Support: N/A 00:28:01.579 Firmware Update Granularity: No Information Provided 00:28:01.579 Per-Namespace SMART Log: No 00:28:01.579 Asymmetric Namespace Access Log Page: Not Supported 00:28:01.579 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:28:01.579 Command Effects Log Page: Not Supported 00:28:01.579 Get Log Page Extended Data: Supported 00:28:01.579 Telemetry Log Pages: Not Supported 00:28:01.579 Persistent Event Log Pages: Not Supported 00:28:01.579 Supported Log Pages Log Page: May Support 00:28:01.579 Commands Supported & Effects Log Page: Not Supported 00:28:01.579 Feature Identifiers & Effects Log Page:May Support 00:28:01.579 NVMe-MI Commands & Effects Log Page: May Support 00:28:01.579 Data Area 4 for Telemetry Log: Not Supported 00:28:01.579 Error Log Page Entries Supported: 128 00:28:01.579 Keep Alive: Not Supported 00:28:01.579 00:28:01.579 NVM Command Set Attributes 00:28:01.579 ========================== 00:28:01.579 Submission Queue Entry Size 00:28:01.579 Max: 1 00:28:01.579 Min: 1 00:28:01.579 Completion Queue Entry Size 00:28:01.579 Max: 1 00:28:01.579 Min: 1 00:28:01.579 Number of Namespaces: 0 00:28:01.579 Compare Command: Not Supported 00:28:01.579 Write Uncorrectable Command: Not Supported 00:28:01.579 Dataset Management Command: Not Supported 00:28:01.579 Write Zeroes Command: Not Supported 00:28:01.579 Set Features Save Field: Not Supported 00:28:01.579 Reservations: Not Supported 00:28:01.579 Timestamp: Not Supported 00:28:01.579 Copy: Not Supported 00:28:01.579 Volatile Write Cache: Not Present 00:28:01.579 Atomic Write Unit (Normal): 1 00:28:01.579 Atomic Write Unit (PFail): 1 00:28:01.579 Atomic Compare & Write Unit: 1 00:28:01.579 Fused Compare & Write: Supported 00:28:01.579 Scatter-Gather List 00:28:01.579 SGL Command Set: Supported 00:28:01.579 SGL Keyed: Supported 00:28:01.579 SGL Bit Bucket Descriptor: Not Supported 00:28:01.579 SGL Metadata Pointer: Not Supported 00:28:01.579 Oversized SGL: Not Supported 00:28:01.579 SGL Metadata Address: Not Supported 00:28:01.579 SGL Offset: Supported 00:28:01.579 Transport SGL Data Block: Not Supported 00:28:01.579 Replay Protected Memory Block: Not Supported 00:28:01.579 00:28:01.579 Firmware Slot Information 00:28:01.579 ========================= 00:28:01.579 Active slot: 0 00:28:01.579 00:28:01.579 00:28:01.579 Error Log 00:28:01.579 ========= 00:28:01.579 00:28:01.579 Active Namespaces 00:28:01.579 ================= 00:28:01.579 Discovery Log Page 00:28:01.579 ================== 00:28:01.579 Generation Counter: 2 00:28:01.579 Number of Records: 2 00:28:01.579 Record Format: 0 00:28:01.579 00:28:01.579 Discovery Log Entry 0 00:28:01.579 ---------------------- 00:28:01.579 Transport Type: 1 (RDMA) 00:28:01.579 Address Family: 1 (IPv4) 00:28:01.579 Subsystem Type: 3 (Current Discovery Subsystem) 00:28:01.579 Entry Flags: 00:28:01.579 Duplicate Returned Information: 1 00:28:01.579 Explicit Persistent Connection Support for Discovery: 1 00:28:01.579 Transport Requirements: 00:28:01.579 Secure Channel: Not Required 00:28:01.579 Port ID: 0 (0x0000) 00:28:01.579 Controller ID: 65535 (0xffff) 00:28:01.579 Admin Max SQ Size: 128 00:28:01.579 Transport Service Identifier: 4420 00:28:01.579 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:28:01.579 Transport Address: 192.168.100.8 00:28:01.579 Transport Specific Address Subtype - RDMA 00:28:01.579 RDMA QP Service Type: 1 (Reliable Connected) 00:28:01.579 RDMA Provider Type: 1 (No provider specified) 00:28:01.579 RDMA CM Service: 1 (RDMA_CM) 00:28:01.579 Discovery Log Entry 1 00:28:01.579 ---------------------- 00:28:01.579 Transport Type: 1 (RDMA) 00:28:01.579 Address Family: 1 (IPv4) 00:28:01.579 Subsystem Type: 2 (NVM Subsystem) 00:28:01.579 Entry Flags: 00:28:01.579 Duplicate Returned Information: 0 00:28:01.579 Explicit Persistent Connection Support for Discovery: 0 00:28:01.579 Transport Requirements: 00:28:01.579 Secure Channel: Not Required 00:28:01.579 Port ID: 0 (0x0000) 00:28:01.579 Controller ID: 65535 (0xffff) 00:28:01.579 Admin Max SQ Size: [2024-04-26 01:02:08.708163] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:28:01.579 [2024-04-26 01:02:08.708170] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 60968 doesn't match qid 00:28:01.579 [2024-04-26 01:02:08.708181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32563 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708185] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 60968 doesn't match qid 00:28:01.579 [2024-04-26 01:02:08.708190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32563 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708194] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 60968 doesn't match qid 00:28:01.579 [2024-04-26 01:02:08.708199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32563 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708203] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 60968 doesn't match qid 00:28:01.579 [2024-04-26 01:02:08.708209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32563 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708215] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183600 00:28:01.579 [2024-04-26 01:02:08.708221] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.579 [2024-04-26 01:02:08.708236] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.579 [2024-04-26 01:02:08.708246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708254] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.579 [2024-04-26 01:02:08.708259] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.579 [2024-04-26 01:02:08.708263] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.579 [2024-04-26 01:02:08.708281] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.579 [2024-04-26 01:02:08.708285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:28:01.579 [2024-04-26 01:02:08.708291] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:28:01.579 [2024-04-26 01:02:08.708295] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:28:01.580 [2024-04-26 01:02:08.708299] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708305] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708310] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708324] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708332] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708339] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708344] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708361] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708369] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708375] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708381] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708400] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708408] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708414] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708420] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708434] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708443] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708449] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708454] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708467] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708475] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708481] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708487] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708505] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708513] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708520] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708544] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708552] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708559] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708564] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708581] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708589] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708596] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708601] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708619] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708627] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708634] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708639] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708656] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708664] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708670] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708676] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708693] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708701] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708707] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708714] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708727] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708735] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708741] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708764] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708772] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708778] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708783] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708804] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708811] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708818] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708823] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708843] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.580 [2024-04-26 01:02:08.708847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:28:01.580 [2024-04-26 01:02:08.708851] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708858] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.580 [2024-04-26 01:02:08.708863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.580 [2024-04-26 01:02:08.708878] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.708882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.708886] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708892] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708897] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.708913] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.708917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.708921] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708927] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.708954] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.708958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.708962] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708969] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.708974] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.708993] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.708996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709000] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709007] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709012] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709028] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709036] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709042] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709047] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709062] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709070] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709076] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709081] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709096] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709104] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709110] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709115] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709134] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709142] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709149] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709181] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709187] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709209] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709217] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709223] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709245] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709253] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709259] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709265] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709279] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709287] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709294] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.581 [2024-04-26 01:02:08.709299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.581 [2024-04-26 01:02:08.709312] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.581 [2024-04-26 01:02:08.709316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:28:01.581 [2024-04-26 01:02:08.709320] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709326] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709332] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709346] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709354] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709362] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709367] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709381] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709389] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709395] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709400] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709415] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709423] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709429] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709435] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709452] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709460] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709466] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709472] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709486] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709494] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709500] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709522] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709530] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709536] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709541] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709560] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709569] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709575] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709581] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709601] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709609] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709615] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709620] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709638] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709646] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709652] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709657] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709674] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709682] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709689] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709694] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709713] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709721] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709727] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709732] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709755] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709763] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709769] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709774] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709796] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709806] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709812] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709835] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709842] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709849] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709854] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709869] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709877] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709883] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709888] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.582 [2024-04-26 01:02:08.709904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.582 [2024-04-26 01:02:08.709908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.582 [2024-04-26 01:02:08.709912] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709918] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.582 [2024-04-26 01:02:08.709923] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.709938] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.709942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.709946] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.709952] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.709957] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.709971] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.709975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.709979] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.709985] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.709990] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710019] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710025] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710030] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710048] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710055] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710062] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710067] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710087] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710095] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710101] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710106] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710124] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710132] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710138] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710143] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710162] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710170] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710176] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710181] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710196] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710204] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710210] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710215] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710234] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710246] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710252] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710258] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710273] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710281] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710287] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710292] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710310] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710317] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710323] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710329] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710350] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710358] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710364] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710369] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710387] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710395] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710401] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710425] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710433] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710439] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710444] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710460] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710468] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710474] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710499] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710506] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710512] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.583 [2024-04-26 01:02:08.710518] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.583 [2024-04-26 01:02:08.710537] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.583 [2024-04-26 01:02:08.710541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:28:01.583 [2024-04-26 01:02:08.710544] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710550] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710556] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710572] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710580] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710586] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710591] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710610] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710618] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710624] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710629] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710648] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710656] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710662] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710668] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710684] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710692] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710698] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710703] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710720] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710728] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710734] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710739] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710758] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710766] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710772] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710777] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710796] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710804] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710810] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710815] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710835] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710843] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710849] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710855] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710869] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710877] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710883] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710890] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710906] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710914] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710920] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710944] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710952] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710958] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710964] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.710984] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.710988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.710992] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.710998] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711003] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.711023] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.711027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.711031] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711037] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711043] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.711062] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.711065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.711069] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711075] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711081] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.711099] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.711103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.711107] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711113] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711119] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.584 [2024-04-26 01:02:08.711138] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.584 [2024-04-26 01:02:08.711142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.584 [2024-04-26 01:02:08.711146] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.584 [2024-04-26 01:02:08.711152] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.711157] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.585 [2024-04-26 01:02:08.711174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.585 [2024-04-26 01:02:08.711177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:28:01.585 [2024-04-26 01:02:08.711181] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.711188] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.711193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.585 [2024-04-26 01:02:08.711209] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.585 [2024-04-26 01:02:08.711213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:28:01.585 [2024-04-26 01:02:08.711217] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.711223] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.711228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.585 [2024-04-26 01:02:08.715243] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.585 [2024-04-26 01:02:08.715249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.585 [2024-04-26 01:02:08.715253] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.715259] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.715264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.585 [2024-04-26 01:02:08.715282] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.585 [2024-04-26 01:02:08.715286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0002 p:0 m:0 dnr:0 00:28:01.585 [2024-04-26 01:02:08.715290] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.585 [2024-04-26 01:02:08.715294] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:28:01.585 128 00:28:01.585 Transport Service Identifier: 4420 00:28:01.585 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:28:01.585 Transport Address: 192.168.100.8 00:28:01.585 Transport Specific Address Subtype - RDMA 00:28:01.585 RDMA QP Service Type: 1 (Reliable Connected) 00:28:01.585 RDMA Provider Type: 1 (No provider specified) 00:28:01.585 RDMA CM Service: 1 (RDMA_CM) 00:28:01.585 01:02:08 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:28:01.850 [2024-04-26 01:02:08.777863] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:28:01.850 [2024-04-26 01:02:08.777905] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid458332 ] 00:28:01.850 EAL: No free 2048 kB hugepages reported on node 1 00:28:01.850 [2024-04-26 01:02:08.816524] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:28:01.850 [2024-04-26 01:02:08.816581] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:28:01.850 [2024-04-26 01:02:08.816596] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:28:01.850 [2024-04-26 01:02:08.816599] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:28:01.850 [2024-04-26 01:02:08.816618] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:28:01.850 [2024-04-26 01:02:08.826674] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:28:01.850 [2024-04-26 01:02:08.839025] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:28:01.850 [2024-04-26 01:02:08.839034] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:28:01.850 [2024-04-26 01:02:08.839039] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839044] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839048] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839051] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839055] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839059] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839063] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839067] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839071] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839075] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839079] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839082] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839086] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839090] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839094] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839098] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839102] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839106] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839112] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839116] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839120] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839123] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839127] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839131] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839135] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839139] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839143] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839146] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839150] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839154] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839158] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.850 [2024-04-26 01:02:08.839162] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:28:01.851 [2024-04-26 01:02:08.839165] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:28:01.851 [2024-04-26 01:02:08.839168] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:28:01.851 [2024-04-26 01:02:08.839180] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.839189] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183600 00:28:01.851 [2024-04-26 01:02:08.845245] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845256] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845261] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:28:01.851 [2024-04-26 01:02:08.845266] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845269] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845279] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845285] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845304] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845315] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845319] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845323] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845331] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845349] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845358] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845361] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845366] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845371] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845377] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845392] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845400] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845404] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845410] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845415] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845431] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845439] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:28:01.851 [2024-04-26 01:02:08.845443] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845446] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845451] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845555] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:28:01.851 [2024-04-26 01:02:08.845558] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845565] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845570] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845589] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845597] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:28:01.851 [2024-04-26 01:02:08.845602] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845608] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845614] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.851 [2024-04-26 01:02:08.845629] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845637] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:28:01.851 [2024-04-26 01:02:08.845640] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:28:01.851 [2024-04-26 01:02:08.845644] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845648] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:28:01.851 [2024-04-26 01:02:08.845656] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:28:01.851 [2024-04-26 01:02:08.845663] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.851 [2024-04-26 01:02:08.845669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183600 00:28:01.851 [2024-04-26 01:02:08.845702] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.851 [2024-04-26 01:02:08.845706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:28:01.851 [2024-04-26 01:02:08.845711] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:28:01.851 [2024-04-26 01:02:08.845715] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:28:01.851 [2024-04-26 01:02:08.845718] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:28:01.851 [2024-04-26 01:02:08.845723] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:28:01.852 [2024-04-26 01:02:08.845727] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:28:01.852 [2024-04-26 01:02:08.845731] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845734] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845739] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845744] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845750] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.852 [2024-04-26 01:02:08.845770] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.845774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.845780] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845786] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.852 [2024-04-26 01:02:08.845791] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845795] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.852 [2024-04-26 01:02:08.845800] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.852 [2024-04-26 01:02:08.845809] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845814] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.852 [2024-04-26 01:02:08.845817] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845821] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845828] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845833] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845838] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.852 [2024-04-26 01:02:08.845856] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.845860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.845864] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:28:01.852 [2024-04-26 01:02:08.845868] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845871] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845876] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845881] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845886] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845892] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.852 [2024-04-26 01:02:08.845907] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.845910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.845947] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845951] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845956] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.845962] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.845969] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x183600 00:28:01.852 [2024-04-26 01:02:08.845998] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.846002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.846011] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:28:01.852 [2024-04-26 01:02:08.846017] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846021] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.846026] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846032] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.846037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183600 00:28:01.852 [2024-04-26 01:02:08.846067] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.846071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.846080] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846084] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.846090] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846096] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.846101] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183600 00:28:01.852 [2024-04-26 01:02:08.846125] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.852 [2024-04-26 01:02:08.846128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:28:01.852 [2024-04-26 01:02:08.846135] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846138] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.852 [2024-04-26 01:02:08.846143] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846149] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846154] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846158] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:28:01.852 [2024-04-26 01:02:08.846162] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:28:01.853 [2024-04-26 01:02:08.846166] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:28:01.853 [2024-04-26 01:02:08.846171] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:28:01.853 [2024-04-26 01:02:08.846182] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846187] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.853 [2024-04-26 01:02:08.846193] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846197] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:28:01.853 [2024-04-26 01:02:08.846206] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846214] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846220] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846225] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:0 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.853 [2024-04-26 01:02:08.846230] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846238] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846253] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846261] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846267] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846271] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:0 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.853 [2024-04-26 01:02:08.846287] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846295] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846300] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846305] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.853 [2024-04-26 01:02:08.846329] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846337] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846344] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846349] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x183600 00:28:01.853 [2024-04-26 01:02:08.846355] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x183600 00:28:01.853 [2024-04-26 01:02:08.846368] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x183600 00:28:01.853 [2024-04-26 01:02:08.846379] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846384] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x183600 00:28:01.853 [2024-04-26 01:02:08.846389] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846403] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846407] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846417] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846431] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846439] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.853 [2024-04-26 01:02:08.846443] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.853 [2024-04-26 01:02:08.846447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:28:01.853 [2024-04-26 01:02:08.846453] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.853 ===================================================== 00:28:01.853 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:01.853 ===================================================== 00:28:01.853 Controller Capabilities/Features 00:28:01.853 ================================ 00:28:01.853 Vendor ID: 8086 00:28:01.853 Subsystem Vendor ID: 8086 00:28:01.853 Serial Number: SPDK00000000000001 00:28:01.853 Model Number: SPDK bdev Controller 00:28:01.853 Firmware Version: 24.05 00:28:01.853 Recommended Arb Burst: 6 00:28:01.853 IEEE OUI Identifier: e4 d2 5c 00:28:01.853 Multi-path I/O 00:28:01.853 May have multiple subsystem ports: Yes 00:28:01.853 May have multiple controllers: Yes 00:28:01.853 Associated with SR-IOV VF: No 00:28:01.853 Max Data Transfer Size: 131072 00:28:01.853 Max Number of Namespaces: 32 00:28:01.853 Max Number of I/O Queues: 127 00:28:01.853 NVMe Specification Version (VS): 1.3 00:28:01.853 NVMe Specification Version (Identify): 1.3 00:28:01.853 Maximum Queue Entries: 128 00:28:01.853 Contiguous Queues Required: Yes 00:28:01.853 Arbitration Mechanisms Supported 00:28:01.853 Weighted Round Robin: Not Supported 00:28:01.853 Vendor Specific: Not Supported 00:28:01.853 Reset Timeout: 15000 ms 00:28:01.853 Doorbell Stride: 4 bytes 00:28:01.853 NVM Subsystem Reset: Not Supported 00:28:01.853 Command Sets Supported 00:28:01.853 NVM Command Set: Supported 00:28:01.854 Boot Partition: Not Supported 00:28:01.854 Memory Page Size Minimum: 4096 bytes 00:28:01.854 Memory Page Size Maximum: 4096 bytes 00:28:01.854 Persistent Memory Region: Not Supported 00:28:01.854 Optional Asynchronous Events Supported 00:28:01.854 Namespace Attribute Notices: Supported 00:28:01.854 Firmware Activation Notices: Not Supported 00:28:01.854 ANA Change Notices: Not Supported 00:28:01.854 PLE Aggregate Log Change Notices: Not Supported 00:28:01.854 LBA Status Info Alert Notices: Not Supported 00:28:01.854 EGE Aggregate Log Change Notices: Not Supported 00:28:01.854 Normal NVM Subsystem Shutdown event: Not Supported 00:28:01.854 Zone Descriptor Change Notices: Not Supported 00:28:01.854 Discovery Log Change Notices: Not Supported 00:28:01.854 Controller Attributes 00:28:01.854 128-bit Host Identifier: Supported 00:28:01.854 Non-Operational Permissive Mode: Not Supported 00:28:01.854 NVM Sets: Not Supported 00:28:01.854 Read Recovery Levels: Not Supported 00:28:01.854 Endurance Groups: Not Supported 00:28:01.854 Predictable Latency Mode: Not Supported 00:28:01.854 Traffic Based Keep ALive: Not Supported 00:28:01.854 Namespace Granularity: Not Supported 00:28:01.854 SQ Associations: Not Supported 00:28:01.854 UUID List: Not Supported 00:28:01.854 Multi-Domain Subsystem: Not Supported 00:28:01.854 Fixed Capacity Management: Not Supported 00:28:01.854 Variable Capacity Management: Not Supported 00:28:01.854 Delete Endurance Group: Not Supported 00:28:01.854 Delete NVM Set: Not Supported 00:28:01.854 Extended LBA Formats Supported: Not Supported 00:28:01.854 Flexible Data Placement Supported: Not Supported 00:28:01.854 00:28:01.854 Controller Memory Buffer Support 00:28:01.854 ================================ 00:28:01.854 Supported: No 00:28:01.854 00:28:01.854 Persistent Memory Region Support 00:28:01.854 ================================ 00:28:01.854 Supported: No 00:28:01.854 00:28:01.854 Admin Command Set Attributes 00:28:01.854 ============================ 00:28:01.854 Security Send/Receive: Not Supported 00:28:01.854 Format NVM: Not Supported 00:28:01.854 Firmware Activate/Download: Not Supported 00:28:01.854 Namespace Management: Not Supported 00:28:01.854 Device Self-Test: Not Supported 00:28:01.854 Directives: Not Supported 00:28:01.854 NVMe-MI: Not Supported 00:28:01.854 Virtualization Management: Not Supported 00:28:01.854 Doorbell Buffer Config: Not Supported 00:28:01.854 Get LBA Status Capability: Not Supported 00:28:01.854 Command & Feature Lockdown Capability: Not Supported 00:28:01.854 Abort Command Limit: 4 00:28:01.854 Async Event Request Limit: 4 00:28:01.854 Number of Firmware Slots: N/A 00:28:01.854 Firmware Slot 1 Read-Only: N/A 00:28:01.854 Firmware Activation Without Reset: N/A 00:28:01.854 Multiple Update Detection Support: N/A 00:28:01.854 Firmware Update Granularity: No Information Provided 00:28:01.854 Per-Namespace SMART Log: No 00:28:01.854 Asymmetric Namespace Access Log Page: Not Supported 00:28:01.854 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:28:01.854 Command Effects Log Page: Supported 00:28:01.854 Get Log Page Extended Data: Supported 00:28:01.854 Telemetry Log Pages: Not Supported 00:28:01.854 Persistent Event Log Pages: Not Supported 00:28:01.854 Supported Log Pages Log Page: May Support 00:28:01.854 Commands Supported & Effects Log Page: Not Supported 00:28:01.854 Feature Identifiers & Effects Log Page:May Support 00:28:01.854 NVMe-MI Commands & Effects Log Page: May Support 00:28:01.854 Data Area 4 for Telemetry Log: Not Supported 00:28:01.854 Error Log Page Entries Supported: 128 00:28:01.854 Keep Alive: Supported 00:28:01.854 Keep Alive Granularity: 10000 ms 00:28:01.854 00:28:01.854 NVM Command Set Attributes 00:28:01.854 ========================== 00:28:01.854 Submission Queue Entry Size 00:28:01.854 Max: 64 00:28:01.854 Min: 64 00:28:01.854 Completion Queue Entry Size 00:28:01.854 Max: 16 00:28:01.854 Min: 16 00:28:01.854 Number of Namespaces: 32 00:28:01.854 Compare Command: Supported 00:28:01.854 Write Uncorrectable Command: Not Supported 00:28:01.854 Dataset Management Command: Supported 00:28:01.854 Write Zeroes Command: Supported 00:28:01.854 Set Features Save Field: Not Supported 00:28:01.854 Reservations: Supported 00:28:01.854 Timestamp: Not Supported 00:28:01.854 Copy: Supported 00:28:01.854 Volatile Write Cache: Present 00:28:01.854 Atomic Write Unit (Normal): 1 00:28:01.854 Atomic Write Unit (PFail): 1 00:28:01.854 Atomic Compare & Write Unit: 1 00:28:01.854 Fused Compare & Write: Supported 00:28:01.854 Scatter-Gather List 00:28:01.854 SGL Command Set: Supported 00:28:01.854 SGL Keyed: Supported 00:28:01.854 SGL Bit Bucket Descriptor: Not Supported 00:28:01.854 SGL Metadata Pointer: Not Supported 00:28:01.854 Oversized SGL: Not Supported 00:28:01.854 SGL Metadata Address: Not Supported 00:28:01.854 SGL Offset: Supported 00:28:01.854 Transport SGL Data Block: Not Supported 00:28:01.854 Replay Protected Memory Block: Not Supported 00:28:01.854 00:28:01.854 Firmware Slot Information 00:28:01.855 ========================= 00:28:01.855 Active slot: 1 00:28:01.855 Slot 1 Firmware Revision: 24.05 00:28:01.855 00:28:01.855 00:28:01.855 Commands Supported and Effects 00:28:01.855 ============================== 00:28:01.855 Admin Commands 00:28:01.855 -------------- 00:28:01.855 Get Log Page (02h): Supported 00:28:01.855 Identify (06h): Supported 00:28:01.855 Abort (08h): Supported 00:28:01.855 Set Features (09h): Supported 00:28:01.855 Get Features (0Ah): Supported 00:28:01.855 Asynchronous Event Request (0Ch): Supported 00:28:01.855 Keep Alive (18h): Supported 00:28:01.855 I/O Commands 00:28:01.855 ------------ 00:28:01.855 Flush (00h): Supported LBA-Change 00:28:01.855 Write (01h): Supported LBA-Change 00:28:01.855 Read (02h): Supported 00:28:01.855 Compare (05h): Supported 00:28:01.855 Write Zeroes (08h): Supported LBA-Change 00:28:01.855 Dataset Management (09h): Supported LBA-Change 00:28:01.855 Copy (19h): Supported LBA-Change 00:28:01.855 Unknown (79h): Supported LBA-Change 00:28:01.855 Unknown (7Ah): Supported 00:28:01.855 00:28:01.855 Error Log 00:28:01.855 ========= 00:28:01.855 00:28:01.855 Arbitration 00:28:01.855 =========== 00:28:01.855 Arbitration Burst: 1 00:28:01.855 00:28:01.855 Power Management 00:28:01.855 ================ 00:28:01.855 Number of Power States: 1 00:28:01.855 Current Power State: Power State #0 00:28:01.855 Power State #0: 00:28:01.855 Max Power: 0.00 W 00:28:01.855 Non-Operational State: Operational 00:28:01.855 Entry Latency: Not Reported 00:28:01.855 Exit Latency: Not Reported 00:28:01.855 Relative Read Throughput: 0 00:28:01.855 Relative Read Latency: 0 00:28:01.855 Relative Write Throughput: 0 00:28:01.855 Relative Write Latency: 0 00:28:01.855 Idle Power: Not Reported 00:28:01.855 Active Power: Not Reported 00:28:01.855 Non-Operational Permissive Mode: Not Supported 00:28:01.855 00:28:01.855 Health Information 00:28:01.855 ================== 00:28:01.855 Critical Warnings: 00:28:01.855 Available Spare Space: OK 00:28:01.855 Temperature: OK 00:28:01.855 Device Reliability: OK 00:28:01.855 Read Only: No 00:28:01.855 Volatile Memory Backup: OK 00:28:01.855 Current Temperature: 0 Kelvin (-273 Celsius) 00:28:01.855 Temperature Threshold: [2024-04-26 01:02:08.846524] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846530] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846544] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846552] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846572] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:28:01.855 [2024-04-26 01:02:08.846578] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34736 doesn't match qid 00:28:01.855 [2024-04-26 01:02:08.846589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32655 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846593] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34736 doesn't match qid 00:28:01.855 [2024-04-26 01:02:08.846599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32655 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846603] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34736 doesn't match qid 00:28:01.855 [2024-04-26 01:02:08.846610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32655 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846614] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34736 doesn't match qid 00:28:01.855 [2024-04-26 01:02:08.846619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32655 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846625] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846630] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846645] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846654] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846659] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846663] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846681] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846689] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:28:01.855 [2024-04-26 01:02:08.846693] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:28:01.855 [2024-04-26 01:02:08.846696] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846702] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846721] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846729] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846735] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846740] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846760] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846768] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846774] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846780] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.855 [2024-04-26 01:02:08.846802] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.855 [2024-04-26 01:02:08.846806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.855 [2024-04-26 01:02:08.846810] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.855 [2024-04-26 01:02:08.846817] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846822] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.846842] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.846846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.846850] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846856] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846861] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.846882] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.846886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.846890] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846896] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846901] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.846922] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.846927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.846931] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846937] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846942] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.846961] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.846965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.846969] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846975] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.846980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.846998] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847006] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847012] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847017] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.847035] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847046] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847052] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847057] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.847078] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847085] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847091] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.847111] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847119] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847125] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847130] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.847151] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847158] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847164] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847170] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.856 [2024-04-26 01:02:08.847183] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.856 [2024-04-26 01:02:08.847187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.856 [2024-04-26 01:02:08.847191] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.856 [2024-04-26 01:02:08.847197] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847202] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847217] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847225] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847231] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847256] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847265] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847272] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847277] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847294] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847302] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847308] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847313] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847329] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847337] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847343] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847348] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847366] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847373] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847379] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847409] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847417] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847423] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847428] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847448] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847456] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847462] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847467] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847488] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847497] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847503] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847509] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847525] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847532] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847539] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847544] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847564] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847572] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847578] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847583] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847600] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:28:01.857 [2024-04-26 01:02:08.847608] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847614] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.857 [2024-04-26 01:02:08.847619] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.857 [2024-04-26 01:02:08.847634] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.857 [2024-04-26 01:02:08.847638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847642] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847648] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847666] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847674] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847680] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847685] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847703] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847710] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847716] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847722] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847740] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847748] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847754] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847759] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847773] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847780] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847787] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847810] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847818] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847824] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847829] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847846] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847853] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847859] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847865] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847885] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847892] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847898] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847904] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847917] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847925] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847931] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847936] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847952] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847960] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847966] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847971] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.847984] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.847988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.847992] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.847998] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848003] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.848025] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.848029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.848032] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848038] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848044] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.848067] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.848070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.848074] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848080] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.858 [2024-04-26 01:02:08.848106] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.858 [2024-04-26 01:02:08.848109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:28:01.858 [2024-04-26 01:02:08.848113] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848119] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.858 [2024-04-26 01:02:08.848124] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848144] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848152] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848158] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848186] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848194] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848200] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848205] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848218] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848226] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848232] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848260] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848268] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848274] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848279] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848298] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848305] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848312] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848337] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848344] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848350] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848357] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848377] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848384] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848390] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848396] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848412] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848420] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848426] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848431] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848450] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848457] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848463] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848468] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848487] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848495] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848501] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848524] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848531] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848537] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848543] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848560] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848567] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848573] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848596] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:28:01.859 [2024-04-26 01:02:08.848603] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848609] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.859 [2024-04-26 01:02:08.848615] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.859 [2024-04-26 01:02:08.848633] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.859 [2024-04-26 01:02:08.848637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848641] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848647] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848652] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848673] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848680] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848686] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848691] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848707] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848715] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848721] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848742] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848750] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848756] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848761] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848776] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848784] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848791] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848796] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848816] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848824] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848830] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848835] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848857] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848864] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848870] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848875] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848897] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848905] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848910] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848916] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848939] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848946] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848952] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848958] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.848976] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.848980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.848984] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848990] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.848995] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.849017] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.849020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.849024] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849031] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849037] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.849056] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.849059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.849063] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849069] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849074] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.849093] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.849097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.849101] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849107] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849112] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.849127] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.849130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:28:01.860 [2024-04-26 01:02:08.849134] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849140] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.860 [2024-04-26 01:02:08.849146] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.860 [2024-04-26 01:02:08.849166] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.860 [2024-04-26 01:02:08.849170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:28:01.861 [2024-04-26 01:02:08.849173] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.849179] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.849185] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.861 [2024-04-26 01:02:08.849204] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.861 [2024-04-26 01:02:08.849207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:28:01.861 [2024-04-26 01:02:08.849211] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.849217] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.849222] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.861 [2024-04-26 01:02:08.853243] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.861 [2024-04-26 01:02:08.853248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:28:01.861 [2024-04-26 01:02:08.853254] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.853261] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.853266] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:28:01.861 [2024-04-26 01:02:08.853280] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:28:01.861 [2024-04-26 01:02:08.853283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:001f p:0 m:0 dnr:0 00:28:01.861 [2024-04-26 01:02:08.853287] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183600 00:28:01.861 [2024-04-26 01:02:08.853292] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:28:01.861 0 Kelvin (-273 Celsius) 00:28:01.861 Available Spare: 0% 00:28:01.861 Available Spare Threshold: 0% 00:28:01.861 Life Percentage Used: 0% 00:28:01.861 Data Units Read: 0 00:28:01.861 Data Units Written: 0 00:28:01.861 Host Read Commands: 0 00:28:01.861 Host Write Commands: 0 00:28:01.861 Controller Busy Time: 0 minutes 00:28:01.861 Power Cycles: 0 00:28:01.861 Power On Hours: 0 hours 00:28:01.861 Unsafe Shutdowns: 0 00:28:01.861 Unrecoverable Media Errors: 0 00:28:01.861 Lifetime Error Log Entries: 0 00:28:01.861 Warning Temperature Time: 0 minutes 00:28:01.861 Critical Temperature Time: 0 minutes 00:28:01.861 00:28:01.861 Number of Queues 00:28:01.861 ================ 00:28:01.861 Number of I/O Submission Queues: 127 00:28:01.861 Number of I/O Completion Queues: 127 00:28:01.861 00:28:01.861 Active Namespaces 00:28:01.861 ================= 00:28:01.861 Namespace ID:1 00:28:01.861 Error Recovery Timeout: Unlimited 00:28:01.861 Command Set Identifier: NVM (00h) 00:28:01.861 Deallocate: Supported 00:28:01.861 Deallocated/Unwritten Error: Not Supported 00:28:01.861 Deallocated Read Value: Unknown 00:28:01.861 Deallocate in Write Zeroes: Not Supported 00:28:01.861 Deallocated Guard Field: 0xFFFF 00:28:01.861 Flush: Supported 00:28:01.861 Reservation: Supported 00:28:01.861 Namespace Sharing Capabilities: Multiple Controllers 00:28:01.861 Size (in LBAs): 131072 (0GiB) 00:28:01.861 Capacity (in LBAs): 131072 (0GiB) 00:28:01.861 Utilization (in LBAs): 131072 (0GiB) 00:28:01.861 NGUID: ABCDEF0123456789ABCDEF0123456789 00:28:01.861 EUI64: ABCDEF0123456789 00:28:01.861 UUID: 06bd0118-5b69-41c0-89bb-7bc820679835 00:28:01.861 Thin Provisioning: Not Supported 00:28:01.861 Per-NS Atomic Units: Yes 00:28:01.861 Atomic Boundary Size (Normal): 0 00:28:01.861 Atomic Boundary Size (PFail): 0 00:28:01.861 Atomic Boundary Offset: 0 00:28:01.861 Maximum Single Source Range Length: 65535 00:28:01.861 Maximum Copy Length: 65535 00:28:01.861 Maximum Source Range Count: 1 00:28:01.861 NGUID/EUI64 Never Reused: No 00:28:01.861 Namespace Write Protected: No 00:28:01.861 Number of LBA Formats: 1 00:28:01.861 Current LBA Format: LBA Format #00 00:28:01.861 LBA Format #00: Data Size: 512 Metadata Size: 0 00:28:01.861 00:28:01.861 01:02:08 -- host/identify.sh@51 -- # sync 00:28:01.861 01:02:08 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:01.861 01:02:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:28:01.861 01:02:08 -- common/autotest_common.sh@10 -- # set +x 00:28:01.861 01:02:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:28:01.861 01:02:08 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:28:01.861 01:02:08 -- host/identify.sh@56 -- # nvmftestfini 00:28:01.861 01:02:08 -- nvmf/common.sh@477 -- # nvmfcleanup 00:28:01.861 01:02:08 -- nvmf/common.sh@117 -- # sync 00:28:01.861 01:02:08 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:28:01.861 01:02:08 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:28:01.861 01:02:08 -- nvmf/common.sh@120 -- # set +e 00:28:01.861 01:02:08 -- nvmf/common.sh@121 -- # for i in {1..20} 00:28:01.861 01:02:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:28:01.861 rmmod nvme_rdma 00:28:01.861 rmmod nvme_fabrics 00:28:01.861 01:02:08 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:28:01.861 01:02:08 -- nvmf/common.sh@124 -- # set -e 00:28:01.861 01:02:08 -- nvmf/common.sh@125 -- # return 0 00:28:01.861 01:02:08 -- nvmf/common.sh@478 -- # '[' -n 458050 ']' 00:28:01.861 01:02:08 -- nvmf/common.sh@479 -- # killprocess 458050 00:28:01.861 01:02:08 -- common/autotest_common.sh@936 -- # '[' -z 458050 ']' 00:28:01.861 01:02:08 -- common/autotest_common.sh@940 -- # kill -0 458050 00:28:01.861 01:02:08 -- common/autotest_common.sh@941 -- # uname 00:28:01.861 01:02:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:01.861 01:02:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 458050 00:28:01.861 01:02:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:01.861 01:02:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:01.861 01:02:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 458050' 00:28:01.861 killing process with pid 458050 00:28:01.861 01:02:08 -- common/autotest_common.sh@955 -- # kill 458050 00:28:01.861 [2024-04-26 01:02:08.996654] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:01.861 01:02:08 -- common/autotest_common.sh@960 -- # wait 458050 00:28:02.122 [2024-04-26 01:02:09.070858] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:28:02.122 01:02:09 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:28:02.122 01:02:09 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:28:02.122 00:28:02.122 real 0m6.948s 00:28:02.122 user 0m7.638s 00:28:02.122 sys 0m4.250s 00:28:02.122 01:02:09 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:28:02.122 01:02:09 -- common/autotest_common.sh@10 -- # set +x 00:28:02.122 ************************************ 00:28:02.122 END TEST nvmf_identify 00:28:02.122 ************************************ 00:28:02.381 01:02:09 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:28:02.381 01:02:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:02.381 01:02:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:02.381 01:02:09 -- common/autotest_common.sh@10 -- # set +x 00:28:02.381 ************************************ 00:28:02.381 START TEST nvmf_perf 00:28:02.381 ************************************ 00:28:02.381 01:02:09 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:28:02.381 * Looking for test storage... 00:28:02.381 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:28:02.381 01:02:09 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:28:02.381 01:02:09 -- nvmf/common.sh@7 -- # uname -s 00:28:02.381 01:02:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:02.381 01:02:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:02.381 01:02:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:02.381 01:02:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:02.381 01:02:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:02.381 01:02:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:02.381 01:02:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:02.381 01:02:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:02.381 01:02:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:02.381 01:02:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:02.381 01:02:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:28:02.381 01:02:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:28:02.381 01:02:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:02.381 01:02:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:02.381 01:02:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:02.381 01:02:09 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:28:02.381 01:02:09 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:28:02.641 01:02:09 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.641 01:02:09 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.641 01:02:09 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.641 01:02:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.641 01:02:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.641 01:02:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.641 01:02:09 -- paths/export.sh@5 -- # export PATH 00:28:02.641 01:02:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.641 01:02:09 -- nvmf/common.sh@47 -- # : 0 00:28:02.641 01:02:09 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:28:02.641 01:02:09 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:28:02.641 01:02:09 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:28:02.641 01:02:09 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:02.641 01:02:09 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:02.641 01:02:09 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:28:02.641 01:02:09 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:28:02.641 01:02:09 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:28:02.641 01:02:09 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:28:02.641 01:02:09 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:28:02.641 01:02:09 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:28:02.641 01:02:09 -- host/perf.sh@17 -- # nvmftestinit 00:28:02.641 01:02:09 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:28:02.641 01:02:09 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:02.641 01:02:09 -- nvmf/common.sh@437 -- # prepare_net_devs 00:28:02.641 01:02:09 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:28:02.641 01:02:09 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:28:02.641 01:02:09 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.641 01:02:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.641 01:02:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.641 01:02:09 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:28:02.641 01:02:09 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:28:02.641 01:02:09 -- nvmf/common.sh@285 -- # xtrace_disable 00:28:02.641 01:02:09 -- common/autotest_common.sh@10 -- # set +x 00:28:07.913 01:02:14 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:07.914 01:02:14 -- nvmf/common.sh@291 -- # pci_devs=() 00:28:07.914 01:02:14 -- nvmf/common.sh@291 -- # local -a pci_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:28:07.914 01:02:14 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@293 -- # pci_drivers=() 00:28:07.914 01:02:14 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:28:07.914 01:02:14 -- nvmf/common.sh@295 -- # net_devs=() 00:28:07.914 01:02:14 -- nvmf/common.sh@295 -- # local -ga net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@296 -- # e810=() 00:28:07.914 01:02:14 -- nvmf/common.sh@296 -- # local -ga e810 00:28:07.914 01:02:14 -- nvmf/common.sh@297 -- # x722=() 00:28:07.914 01:02:14 -- nvmf/common.sh@297 -- # local -ga x722 00:28:07.914 01:02:14 -- nvmf/common.sh@298 -- # mlx=() 00:28:07.914 01:02:14 -- nvmf/common.sh@298 -- # local -ga mlx 00:28:07.914 01:02:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:07.914 01:02:14 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:28:07.914 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:28:07.914 01:02:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:07.914 01:02:14 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:28:07.914 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:28:07.914 01:02:14 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:28:07.914 01:02:14 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:07.914 01:02:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:07.914 01:02:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:28:07.914 Found net devices under 0000:18:00.0: mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:07.914 01:02:14 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:07.914 01:02:14 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:28:07.914 Found net devices under 0000:18:00.1: mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:28:07.914 01:02:14 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@403 -- # is_hw=yes 00:28:07.914 01:02:14 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@409 -- # rdma_device_init 00:28:07.914 01:02:14 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:28:07.914 01:02:14 -- nvmf/common.sh@58 -- # uname 00:28:07.914 01:02:14 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:28:07.914 01:02:14 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:28:07.914 01:02:14 -- nvmf/common.sh@63 -- # modprobe ib_core 00:28:07.914 01:02:14 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:28:07.914 01:02:14 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:28:07.914 01:02:14 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:28:07.914 01:02:14 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:28:07.914 01:02:14 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:28:07.914 01:02:14 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:28:07.914 01:02:14 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:28:07.914 01:02:14 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:28:07.914 01:02:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:07.914 01:02:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:07.914 01:02:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@105 -- # continue 2 00:28:07.914 01:02:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@105 -- # continue 2 00:28:07.914 01:02:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:07.914 01:02:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:07.914 01:02:14 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:28:07.914 01:02:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:28:07.914 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:28:07.914 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:28:07.914 altname enp24s0f0np0 00:28:07.914 altname ens785f0np0 00:28:07.914 inet 192.168.100.8/24 scope global mlx_0_0 00:28:07.914 valid_lft forever preferred_lft forever 00:28:07.914 01:02:14 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:28:07.914 01:02:14 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:07.914 01:02:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:07.914 01:02:14 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:28:07.914 01:02:14 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:28:07.914 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:28:07.914 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:28:07.914 altname enp24s0f1np1 00:28:07.914 altname ens785f1np1 00:28:07.914 inet 192.168.100.9/24 scope global mlx_0_1 00:28:07.914 valid_lft forever preferred_lft forever 00:28:07.914 01:02:14 -- nvmf/common.sh@411 -- # return 0 00:28:07.914 01:02:14 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:28:07.914 01:02:14 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:28:07.914 01:02:14 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:28:07.914 01:02:14 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:28:07.914 01:02:14 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:28:07.914 01:02:14 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:28:07.914 01:02:14 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:28:07.914 01:02:14 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:28:07.914 01:02:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:28:07.914 01:02:14 -- nvmf/common.sh@105 -- # continue 2 00:28:07.914 01:02:14 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:28:07.914 01:02:14 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:28:07.914 01:02:14 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:28:07.914 01:02:14 -- nvmf/common.sh@105 -- # continue 2 00:28:07.914 01:02:14 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:07.914 01:02:14 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:28:07.915 01:02:14 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:28:07.915 01:02:14 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:28:07.915 01:02:14 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:07.915 01:02:14 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:07.915 01:02:15 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:28:07.915 01:02:15 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:28:07.915 01:02:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:28:07.915 01:02:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:28:07.915 01:02:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:28:07.915 01:02:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:28:07.915 01:02:15 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:28:07.915 192.168.100.9' 00:28:07.915 01:02:15 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:28:07.915 192.168.100.9' 00:28:07.915 01:02:15 -- nvmf/common.sh@446 -- # head -n 1 00:28:07.915 01:02:15 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:28:07.915 01:02:15 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:28:07.915 192.168.100.9' 00:28:07.915 01:02:15 -- nvmf/common.sh@447 -- # tail -n +2 00:28:07.915 01:02:15 -- nvmf/common.sh@447 -- # head -n 1 00:28:07.915 01:02:15 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:28:07.915 01:02:15 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:28:07.915 01:02:15 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:28:07.915 01:02:15 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:28:07.915 01:02:15 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:28:07.915 01:02:15 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:28:07.915 01:02:15 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:28:07.915 01:02:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:28:07.915 01:02:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:28:07.915 01:02:15 -- common/autotest_common.sh@10 -- # set +x 00:28:07.915 01:02:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:28:07.915 01:02:15 -- nvmf/common.sh@470 -- # nvmfpid=461588 00:28:07.915 01:02:15 -- nvmf/common.sh@471 -- # waitforlisten 461588 00:28:07.915 01:02:15 -- common/autotest_common.sh@817 -- # '[' -z 461588 ']' 00:28:07.915 01:02:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:07.915 01:02:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:28:07.915 01:02:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:07.915 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:07.915 01:02:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:28:07.915 01:02:15 -- common/autotest_common.sh@10 -- # set +x 00:28:07.915 [2024-04-26 01:02:15.082111] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:28:07.915 [2024-04-26 01:02:15.082152] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:07.915 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.174 [2024-04-26 01:02:15.129683] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:08.174 [2024-04-26 01:02:15.201887] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:08.174 [2024-04-26 01:02:15.201925] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:08.174 [2024-04-26 01:02:15.201931] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:28:08.174 [2024-04-26 01:02:15.201936] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:28:08.174 [2024-04-26 01:02:15.201940] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:08.174 [2024-04-26 01:02:15.201985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:08.174 [2024-04-26 01:02:15.202003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:08.174 [2024-04-26 01:02:15.202087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:08.174 [2024-04-26 01:02:15.202089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:08.741 01:02:15 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:28:08.741 01:02:15 -- common/autotest_common.sh@850 -- # return 0 00:28:08.741 01:02:15 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:28:08.741 01:02:15 -- common/autotest_common.sh@716 -- # xtrace_disable 00:28:08.741 01:02:15 -- common/autotest_common.sh@10 -- # set +x 00:28:08.741 01:02:15 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:08.741 01:02:15 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:08.741 01:02:15 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:28:12.034 01:02:18 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:28:12.034 01:02:18 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:28:12.034 01:02:19 -- host/perf.sh@30 -- # local_nvme_trid=0000:d8:00.0 00:28:12.034 01:02:19 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:28:12.292 01:02:19 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:28:12.292 01:02:19 -- host/perf.sh@33 -- # '[' -n 0000:d8:00.0 ']' 00:28:12.292 01:02:19 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:28:12.292 01:02:19 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:28:12.292 01:02:19 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:28:12.292 [2024-04-26 01:02:19.394330] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:28:12.292 [2024-04-26 01:02:19.413577] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19c6cf0/0x1b14a00) succeed. 00:28:12.292 [2024-04-26 01:02:19.423064] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x19c8330/0x19d4800) succeed. 00:28:12.551 01:02:19 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:12.551 01:02:19 -- host/perf.sh@45 -- # for bdev in $bdevs 00:28:12.551 01:02:19 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:12.809 01:02:19 -- host/perf.sh@45 -- # for bdev in $bdevs 00:28:12.809 01:02:19 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:13.067 01:02:20 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:13.067 [2024-04-26 01:02:20.169282] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:28:13.067 01:02:20 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:28:13.327 01:02:20 -- host/perf.sh@52 -- # '[' -n 0000:d8:00.0 ']' 00:28:13.327 01:02:20 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:d8:00.0' 00:28:13.327 01:02:20 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:28:13.327 01:02:20 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:d8:00.0' 00:28:14.707 Initializing NVMe Controllers 00:28:14.707 Attached to NVMe Controller at 0000:d8:00.0 [8086:0a54] 00:28:14.707 Associating PCIE (0000:d8:00.0) NSID 1 with lcore 0 00:28:14.707 Initialization complete. Launching workers. 00:28:14.707 ======================================================== 00:28:14.707 Latency(us) 00:28:14.707 Device Information : IOPS MiB/s Average min max 00:28:14.707 PCIE (0000:d8:00.0) NSID 1 from core 0: 106773.34 417.08 299.31 30.42 8186.02 00:28:14.707 ======================================================== 00:28:14.707 Total : 106773.34 417.08 299.31 30.42 8186.02 00:28:14.707 00:28:14.707 01:02:21 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:14.707 EAL: No free 2048 kB hugepages reported on node 1 00:28:18.009 Initializing NVMe Controllers 00:28:18.009 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:18.009 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:18.009 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:18.009 Initialization complete. Launching workers. 00:28:18.009 ======================================================== 00:28:18.009 Latency(us) 00:28:18.009 Device Information : IOPS MiB/s Average min max 00:28:18.010 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7205.97 28.15 138.58 45.24 6050.96 00:28:18.010 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5534.98 21.62 180.49 65.82 6003.95 00:28:18.010 ======================================================== 00:28:18.010 Total : 12740.95 49.77 156.79 45.24 6050.96 00:28:18.010 00:28:18.010 01:02:24 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:18.010 EAL: No free 2048 kB hugepages reported on node 1 00:28:21.299 Initializing NVMe Controllers 00:28:21.299 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:21.299 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:21.299 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:21.299 Initialization complete. Launching workers. 00:28:21.299 ======================================================== 00:28:21.299 Latency(us) 00:28:21.299 Device Information : IOPS MiB/s Average min max 00:28:21.299 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19732.73 77.08 1622.41 451.15 5383.55 00:28:21.299 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4060.45 15.86 7940.35 4824.38 8194.07 00:28:21.299 ======================================================== 00:28:21.299 Total : 23793.18 92.94 2700.60 451.15 8194.07 00:28:21.299 00:28:21.299 01:02:28 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:28:21.299 01:02:28 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:21.299 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.492 Initializing NVMe Controllers 00:28:25.492 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:25.492 Controller IO queue size 128, less than required. 00:28:25.492 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:25.492 Controller IO queue size 128, less than required. 00:28:25.492 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:25.492 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:25.492 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:25.492 Initialization complete. Launching workers. 00:28:25.492 ======================================================== 00:28:25.492 Latency(us) 00:28:25.492 Device Information : IOPS MiB/s Average min max 00:28:25.492 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3708.50 927.12 34666.46 15345.74 84579.97 00:28:25.492 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3785.50 946.38 33591.00 15436.54 55545.61 00:28:25.492 ======================================================== 00:28:25.492 Total : 7494.00 1873.50 34123.20 15345.74 84579.97 00:28:25.492 00:28:25.492 01:02:32 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:28:25.492 EAL: No free 2048 kB hugepages reported on node 1 00:28:25.751 No valid NVMe controllers or AIO or URING devices found 00:28:26.010 Initializing NVMe Controllers 00:28:26.010 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:26.010 Controller IO queue size 128, less than required. 00:28:26.010 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:26.010 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:28:26.010 Controller IO queue size 128, less than required. 00:28:26.010 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:26.010 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:28:26.010 WARNING: Some requested NVMe devices were skipped 00:28:26.010 01:02:32 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:28:26.010 EAL: No free 2048 kB hugepages reported on node 1 00:28:30.231 Initializing NVMe Controllers 00:28:30.231 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:30.231 Controller IO queue size 128, less than required. 00:28:30.231 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:30.231 Controller IO queue size 128, less than required. 00:28:30.231 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:28:30.231 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:30.231 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:28:30.231 Initialization complete. Launching workers. 00:28:30.231 00:28:30.231 ==================== 00:28:30.231 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:28:30.231 RDMA transport: 00:28:30.231 dev name: mlx5_0 00:28:30.231 polls: 433290 00:28:30.231 idle_polls: 429166 00:28:30.231 completions: 47554 00:28:30.231 queued_requests: 1 00:28:30.231 total_send_wrs: 23777 00:28:30.231 send_doorbell_updates: 3885 00:28:30.231 total_recv_wrs: 23904 00:28:30.231 recv_doorbell_updates: 3901 00:28:30.231 --------------------------------- 00:28:30.231 00:28:30.231 ==================== 00:28:30.231 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:28:30.231 RDMA transport: 00:28:30.231 dev name: mlx5_0 00:28:30.231 polls: 436426 00:28:30.231 idle_polls: 436133 00:28:30.231 completions: 21198 00:28:30.231 queued_requests: 1 00:28:30.231 total_send_wrs: 10599 00:28:30.231 send_doorbell_updates: 261 00:28:30.231 total_recv_wrs: 10726 00:28:30.231 recv_doorbell_updates: 262 00:28:30.231 --------------------------------- 00:28:30.231 ======================================================== 00:28:30.231 Latency(us) 00:28:30.231 Device Information : IOPS MiB/s Average min max 00:28:30.231 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5943.35 1485.84 21514.48 10836.27 57006.97 00:28:30.231 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2649.21 662.30 48027.98 24113.13 72955.15 00:28:30.231 ======================================================== 00:28:30.231 Total : 8592.55 2148.14 29688.97 10836.27 72955.15 00:28:30.231 00:28:30.231 01:02:37 -- host/perf.sh@66 -- # sync 00:28:30.231 01:02:37 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:30.490 01:02:37 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:28:30.490 01:02:37 -- host/perf.sh@71 -- # '[' -n 0000:d8:00.0 ']' 00:28:30.490 01:02:37 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:28:42.697 01:02:49 -- host/perf.sh@72 -- # ls_guid=197405ad-74c3-4379-84a1-c169edb72584 00:28:42.697 01:02:49 -- host/perf.sh@73 -- # get_lvs_free_mb 197405ad-74c3-4379-84a1-c169edb72584 00:28:42.697 01:02:49 -- common/autotest_common.sh@1350 -- # local lvs_uuid=197405ad-74c3-4379-84a1-c169edb72584 00:28:42.697 01:02:49 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:42.697 01:02:49 -- common/autotest_common.sh@1352 -- # local fc 00:28:42.697 01:02:49 -- common/autotest_common.sh@1353 -- # local cs 00:28:42.697 01:02:49 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:42.697 01:02:49 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:42.697 { 00:28:42.697 "uuid": "197405ad-74c3-4379-84a1-c169edb72584", 00:28:42.697 "name": "lvs_0", 00:28:42.697 "base_bdev": "Nvme0n1", 00:28:42.697 "total_data_clusters": 952929, 00:28:42.697 "free_clusters": 952929, 00:28:42.697 "block_size": 512, 00:28:42.697 "cluster_size": 4194304 00:28:42.697 } 00:28:42.697 ]' 00:28:42.697 01:02:49 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="197405ad-74c3-4379-84a1-c169edb72584") .free_clusters' 00:28:42.697 01:02:49 -- common/autotest_common.sh@1355 -- # fc=952929 00:28:42.697 01:02:49 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="197405ad-74c3-4379-84a1-c169edb72584") .cluster_size' 00:28:42.697 01:02:49 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:42.697 01:02:49 -- common/autotest_common.sh@1359 -- # free_mb=3811716 00:28:42.697 01:02:49 -- common/autotest_common.sh@1360 -- # echo 3811716 00:28:42.697 3811716 00:28:42.697 01:02:49 -- host/perf.sh@77 -- # '[' 3811716 -gt 20480 ']' 00:28:42.697 01:02:49 -- host/perf.sh@78 -- # free_mb=20480 00:28:42.697 01:02:49 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 197405ad-74c3-4379-84a1-c169edb72584 lbd_0 20480 00:28:44.077 01:02:51 -- host/perf.sh@80 -- # lb_guid=3bb38210-67ff-4edb-856f-c119e7109d1f 00:28:44.077 01:02:51 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 3bb38210-67ff-4edb-856f-c119e7109d1f lvs_n_0 00:28:45.985 01:02:52 -- host/perf.sh@83 -- # ls_nested_guid=f631dc6d-5ce0-408a-95f3-c74ca14bcd73 00:28:45.985 01:02:52 -- host/perf.sh@84 -- # get_lvs_free_mb f631dc6d-5ce0-408a-95f3-c74ca14bcd73 00:28:45.985 01:02:52 -- common/autotest_common.sh@1350 -- # local lvs_uuid=f631dc6d-5ce0-408a-95f3-c74ca14bcd73 00:28:45.985 01:02:52 -- common/autotest_common.sh@1351 -- # local lvs_info 00:28:45.985 01:02:52 -- common/autotest_common.sh@1352 -- # local fc 00:28:45.985 01:02:52 -- common/autotest_common.sh@1353 -- # local cs 00:28:45.985 01:02:52 -- common/autotest_common.sh@1354 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:45.985 01:02:52 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:28:45.985 { 00:28:45.985 "uuid": "197405ad-74c3-4379-84a1-c169edb72584", 00:28:45.985 "name": "lvs_0", 00:28:45.985 "base_bdev": "Nvme0n1", 00:28:45.985 "total_data_clusters": 952929, 00:28:45.985 "free_clusters": 947809, 00:28:45.985 "block_size": 512, 00:28:45.985 "cluster_size": 4194304 00:28:45.985 }, 00:28:45.985 { 00:28:45.985 "uuid": "f631dc6d-5ce0-408a-95f3-c74ca14bcd73", 00:28:45.985 "name": "lvs_n_0", 00:28:45.985 "base_bdev": "3bb38210-67ff-4edb-856f-c119e7109d1f", 00:28:45.985 "total_data_clusters": 5114, 00:28:45.985 "free_clusters": 5114, 00:28:45.985 "block_size": 512, 00:28:45.985 "cluster_size": 4194304 00:28:45.985 } 00:28:45.985 ]' 00:28:45.985 01:02:52 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="f631dc6d-5ce0-408a-95f3-c74ca14bcd73") .free_clusters' 00:28:45.985 01:02:52 -- common/autotest_common.sh@1355 -- # fc=5114 00:28:45.985 01:02:52 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="f631dc6d-5ce0-408a-95f3-c74ca14bcd73") .cluster_size' 00:28:45.985 01:02:52 -- common/autotest_common.sh@1356 -- # cs=4194304 00:28:45.985 01:02:52 -- common/autotest_common.sh@1359 -- # free_mb=20456 00:28:45.985 01:02:52 -- common/autotest_common.sh@1360 -- # echo 20456 00:28:45.985 20456 00:28:45.985 01:02:52 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:28:45.985 01:02:52 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f631dc6d-5ce0-408a-95f3-c74ca14bcd73 lbd_nest_0 20456 00:28:46.243 01:02:53 -- host/perf.sh@88 -- # lb_nested_guid=43982133-479a-4cdb-86b2-80ea2f5936c9 00:28:46.243 01:02:53 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:46.243 01:02:53 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:28:46.243 01:02:53 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 43982133-479a-4cdb-86b2-80ea2f5936c9 00:28:46.502 01:02:53 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:28:46.502 01:02:53 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:28:46.502 01:02:53 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:28:46.502 01:02:53 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:28:46.502 01:02:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:46.502 01:02:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:46.760 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.967 Initializing NVMe Controllers 00:28:58.967 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:28:58.967 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:28:58.967 Initialization complete. Launching workers. 00:28:58.967 ======================================================== 00:28:58.967 Latency(us) 00:28:58.967 Device Information : IOPS MiB/s Average min max 00:28:58.968 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6222.40 3.04 160.31 65.14 7064.75 00:28:58.968 ======================================================== 00:28:58.968 Total : 6222.40 3.04 160.31 65.14 7064.75 00:28:58.968 00:28:58.968 01:03:05 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:28:58.968 01:03:05 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:28:58.968 EAL: No free 2048 kB hugepages reported on node 1 00:29:11.182 Initializing NVMe Controllers 00:29:11.182 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:11.182 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:11.182 Initialization complete. Launching workers. 00:29:11.182 ======================================================== 00:29:11.182 Latency(us) 00:29:11.182 Device Information : IOPS MiB/s Average min max 00:29:11.182 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 2729.10 341.14 365.79 151.26 8162.46 00:29:11.182 ======================================================== 00:29:11.182 Total : 2729.10 341.14 365.79 151.26 8162.46 00:29:11.182 00:29:11.182 01:03:16 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:29:11.182 01:03:16 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:11.182 01:03:16 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:11.182 EAL: No free 2048 kB hugepages reported on node 1 00:29:21.168 Initializing NVMe Controllers 00:29:21.168 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:21.168 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:21.168 Initialization complete. Launching workers. 00:29:21.168 ======================================================== 00:29:21.168 Latency(us) 00:29:21.168 Device Information : IOPS MiB/s Average min max 00:29:21.168 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12360.61 6.04 2588.94 819.34 9660.69 00:29:21.168 ======================================================== 00:29:21.168 Total : 12360.61 6.04 2588.94 819.34 9660.69 00:29:21.168 00:29:21.168 01:03:27 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:21.168 01:03:27 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:21.168 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.380 Initializing NVMe Controllers 00:29:33.380 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:33.380 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:33.380 Initialization complete. Launching workers. 00:29:33.380 ======================================================== 00:29:33.380 Latency(us) 00:29:33.380 Device Information : IOPS MiB/s Average min max 00:29:33.380 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3979.80 497.48 8045.80 5911.56 16019.79 00:29:33.380 ======================================================== 00:29:33.380 Total : 3979.80 497.48 8045.80 5911.56 16019.79 00:29:33.380 00:29:33.380 01:03:39 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:29:33.380 01:03:39 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:33.380 01:03:39 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:33.380 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.362 Initializing NVMe Controllers 00:29:43.362 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:43.362 Controller IO queue size 128, less than required. 00:29:43.362 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:43.362 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:43.362 Initialization complete. Launching workers. 00:29:43.362 ======================================================== 00:29:43.362 Latency(us) 00:29:43.362 Device Information : IOPS MiB/s Average min max 00:29:43.362 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19743.30 9.64 6485.53 1847.03 14872.19 00:29:43.362 ======================================================== 00:29:43.362 Total : 19743.30 9.64 6485.53 1847.03 14872.19 00:29:43.362 00:29:43.362 01:03:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:29:43.363 01:03:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:29:43.363 EAL: No free 2048 kB hugepages reported on node 1 00:29:55.579 Initializing NVMe Controllers 00:29:55.579 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:29:55.579 Controller IO queue size 128, less than required. 00:29:55.579 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:29:55.579 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:29:55.579 Initialization complete. Launching workers. 00:29:55.579 ======================================================== 00:29:55.579 Latency(us) 00:29:55.579 Device Information : IOPS MiB/s Average min max 00:29:55.579 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11520.79 1440.10 11113.99 3072.75 22874.32 00:29:55.579 ======================================================== 00:29:55.579 Total : 11520.79 1440.10 11113.99 3072.75 22874.32 00:29:55.579 00:29:55.579 01:04:01 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:55.579 01:04:01 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 43982133-479a-4cdb-86b2-80ea2f5936c9 00:29:55.579 01:04:02 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:29:55.579 01:04:02 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3bb38210-67ff-4edb-856f-c119e7109d1f 00:29:55.838 01:04:02 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:29:56.096 01:04:03 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:29:56.096 01:04:03 -- host/perf.sh@114 -- # nvmftestfini 00:29:56.096 01:04:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:29:56.097 01:04:03 -- nvmf/common.sh@117 -- # sync 00:29:56.097 01:04:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:29:56.097 01:04:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:29:56.097 01:04:03 -- nvmf/common.sh@120 -- # set +e 00:29:56.097 01:04:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:29:56.097 01:04:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:29:56.097 rmmod nvme_rdma 00:29:56.097 rmmod nvme_fabrics 00:29:56.097 01:04:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:29:56.097 01:04:03 -- nvmf/common.sh@124 -- # set -e 00:29:56.097 01:04:03 -- nvmf/common.sh@125 -- # return 0 00:29:56.097 01:04:03 -- nvmf/common.sh@478 -- # '[' -n 461588 ']' 00:29:56.097 01:04:03 -- nvmf/common.sh@479 -- # killprocess 461588 00:29:56.097 01:04:03 -- common/autotest_common.sh@936 -- # '[' -z 461588 ']' 00:29:56.097 01:04:03 -- common/autotest_common.sh@940 -- # kill -0 461588 00:29:56.097 01:04:03 -- common/autotest_common.sh@941 -- # uname 00:29:56.097 01:04:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:56.097 01:04:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 461588 00:29:56.097 01:04:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:56.097 01:04:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:56.097 01:04:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 461588' 00:29:56.097 killing process with pid 461588 00:29:56.097 01:04:03 -- common/autotest_common.sh@955 -- # kill 461588 00:29:56.097 01:04:03 -- common/autotest_common.sh@960 -- # wait 461588 00:29:56.097 [2024-04-26 01:04:03.195630] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:30:00.305 01:04:07 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:30:00.305 01:04:07 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:30:00.305 00:30:00.305 real 1m57.564s 00:30:00.305 user 7m30.243s 00:30:00.305 sys 0m5.677s 00:30:00.305 01:04:07 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:30:00.305 01:04:07 -- common/autotest_common.sh@10 -- # set +x 00:30:00.305 ************************************ 00:30:00.305 END TEST nvmf_perf 00:30:00.305 ************************************ 00:30:00.305 01:04:07 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:30:00.305 01:04:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:00.305 01:04:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:00.305 01:04:07 -- common/autotest_common.sh@10 -- # set +x 00:30:00.305 ************************************ 00:30:00.305 START TEST nvmf_fio_host 00:30:00.305 ************************************ 00:30:00.305 01:04:07 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:30:00.305 * Looking for test storage... 00:30:00.305 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:30:00.305 01:04:07 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:30:00.305 01:04:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:00.305 01:04:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:00.305 01:04:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:00.305 01:04:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.305 01:04:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.305 01:04:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.305 01:04:07 -- paths/export.sh@5 -- # export PATH 00:30:00.305 01:04:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.305 01:04:07 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:30:00.305 01:04:07 -- nvmf/common.sh@7 -- # uname -s 00:30:00.305 01:04:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:00.305 01:04:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:00.305 01:04:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:00.305 01:04:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:00.305 01:04:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:00.305 01:04:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:00.305 01:04:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:00.305 01:04:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:00.305 01:04:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:00.305 01:04:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:00.305 01:04:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:30:00.305 01:04:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:30:00.305 01:04:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:00.305 01:04:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:00.305 01:04:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:00.305 01:04:07 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:30:00.305 01:04:07 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:30:00.305 01:04:07 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:00.305 01:04:07 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:00.306 01:04:07 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:00.306 01:04:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.306 01:04:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.306 01:04:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.306 01:04:07 -- paths/export.sh@5 -- # export PATH 00:30:00.306 01:04:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:00.306 01:04:07 -- nvmf/common.sh@47 -- # : 0 00:30:00.306 01:04:07 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:30:00.306 01:04:07 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:30:00.306 01:04:07 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:30:00.306 01:04:07 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:00.306 01:04:07 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:00.306 01:04:07 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:30:00.306 01:04:07 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:30:00.306 01:04:07 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:30:00.306 01:04:07 -- host/fio.sh@12 -- # nvmftestinit 00:30:00.306 01:04:07 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:30:00.306 01:04:07 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:00.306 01:04:07 -- nvmf/common.sh@437 -- # prepare_net_devs 00:30:00.306 01:04:07 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:30:00.306 01:04:07 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:30:00.306 01:04:07 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:00.306 01:04:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:00.306 01:04:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:00.306 01:04:07 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:30:00.306 01:04:07 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:30:00.306 01:04:07 -- nvmf/common.sh@285 -- # xtrace_disable 00:30:00.306 01:04:07 -- common/autotest_common.sh@10 -- # set +x 00:30:05.704 01:04:12 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:05.704 01:04:12 -- nvmf/common.sh@291 -- # pci_devs=() 00:30:05.704 01:04:12 -- nvmf/common.sh@291 -- # local -a pci_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:30:05.704 01:04:12 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@293 -- # pci_drivers=() 00:30:05.704 01:04:12 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:30:05.704 01:04:12 -- nvmf/common.sh@295 -- # net_devs=() 00:30:05.704 01:04:12 -- nvmf/common.sh@295 -- # local -ga net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@296 -- # e810=() 00:30:05.704 01:04:12 -- nvmf/common.sh@296 -- # local -ga e810 00:30:05.704 01:04:12 -- nvmf/common.sh@297 -- # x722=() 00:30:05.704 01:04:12 -- nvmf/common.sh@297 -- # local -ga x722 00:30:05.704 01:04:12 -- nvmf/common.sh@298 -- # mlx=() 00:30:05.704 01:04:12 -- nvmf/common.sh@298 -- # local -ga mlx 00:30:05.704 01:04:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:05.704 01:04:12 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:30:05.704 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:30:05.704 01:04:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:05.704 01:04:12 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:30:05.704 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:30:05.704 01:04:12 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:30:05.704 01:04:12 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:05.704 01:04:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:05.704 01:04:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:30:05.704 Found net devices under 0000:18:00.0: mlx_0_0 00:30:05.704 01:04:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:05.704 01:04:12 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:05.704 01:04:12 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:30:05.704 Found net devices under 0000:18:00.1: mlx_0_1 00:30:05.704 01:04:12 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:30:05.704 01:04:12 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@403 -- # is_hw=yes 00:30:05.704 01:04:12 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@409 -- # rdma_device_init 00:30:05.704 01:04:12 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:30:05.704 01:04:12 -- nvmf/common.sh@58 -- # uname 00:30:05.704 01:04:12 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:30:05.704 01:04:12 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:30:05.704 01:04:12 -- nvmf/common.sh@63 -- # modprobe ib_core 00:30:05.704 01:04:12 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:30:05.704 01:04:12 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:30:05.704 01:04:12 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:30:05.704 01:04:12 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:30:05.704 01:04:12 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:30:05.704 01:04:12 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:30:05.704 01:04:12 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:30:05.704 01:04:12 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:30:05.704 01:04:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:05.704 01:04:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:05.704 01:04:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:30:05.704 01:04:12 -- nvmf/common.sh@105 -- # continue 2 00:30:05.704 01:04:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:30:05.704 01:04:12 -- nvmf/common.sh@105 -- # continue 2 00:30:05.704 01:04:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:05.704 01:04:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:30:05.704 01:04:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:05.704 01:04:12 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:30:05.704 01:04:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:30:05.704 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:30:05.704 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:30:05.704 altname enp24s0f0np0 00:30:05.704 altname ens785f0np0 00:30:05.704 inet 192.168.100.8/24 scope global mlx_0_0 00:30:05.704 valid_lft forever preferred_lft forever 00:30:05.704 01:04:12 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:30:05.704 01:04:12 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:30:05.704 01:04:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:05.704 01:04:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:05.704 01:04:12 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:30:05.704 01:04:12 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:30:05.704 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:30:05.704 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:30:05.704 altname enp24s0f1np1 00:30:05.704 altname ens785f1np1 00:30:05.704 inet 192.168.100.9/24 scope global mlx_0_1 00:30:05.704 valid_lft forever preferred_lft forever 00:30:05.704 01:04:12 -- nvmf/common.sh@411 -- # return 0 00:30:05.704 01:04:12 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:30:05.704 01:04:12 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:30:05.704 01:04:12 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:30:05.704 01:04:12 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:30:05.704 01:04:12 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:30:05.704 01:04:12 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:30:05.704 01:04:12 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:30:05.704 01:04:12 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:30:05.704 01:04:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.704 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:30:05.704 01:04:12 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:30:05.705 01:04:12 -- nvmf/common.sh@105 -- # continue 2 00:30:05.705 01:04:12 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:30:05.705 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.705 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:30:05.705 01:04:12 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:30:05.705 01:04:12 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:30:05.705 01:04:12 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:30:05.705 01:04:12 -- nvmf/common.sh@105 -- # continue 2 00:30:05.705 01:04:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:05.705 01:04:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:30:05.705 01:04:12 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:05.705 01:04:12 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:30:05.705 01:04:12 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:30:05.705 01:04:12 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:30:05.705 01:04:12 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:30:05.705 01:04:12 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:30:05.705 192.168.100.9' 00:30:05.705 01:04:12 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:30:05.705 192.168.100.9' 00:30:05.705 01:04:12 -- nvmf/common.sh@446 -- # head -n 1 00:30:05.705 01:04:12 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:30:05.705 01:04:12 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:30:05.705 192.168.100.9' 00:30:05.705 01:04:12 -- nvmf/common.sh@447 -- # tail -n +2 00:30:05.705 01:04:12 -- nvmf/common.sh@447 -- # head -n 1 00:30:05.705 01:04:12 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:30:05.705 01:04:12 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:30:05.705 01:04:12 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:30:05.705 01:04:12 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:30:05.705 01:04:12 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:30:05.705 01:04:12 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:30:05.705 01:04:12 -- host/fio.sh@14 -- # [[ y != y ]] 00:30:05.705 01:04:12 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:30:05.705 01:04:12 -- common/autotest_common.sh@710 -- # xtrace_disable 00:30:05.705 01:04:12 -- common/autotest_common.sh@10 -- # set +x 00:30:05.705 01:04:12 -- host/fio.sh@22 -- # nvmfpid=484869 00:30:05.705 01:04:12 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:05.705 01:04:12 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:30:05.705 01:04:12 -- host/fio.sh@26 -- # waitforlisten 484869 00:30:05.705 01:04:12 -- common/autotest_common.sh@817 -- # '[' -z 484869 ']' 00:30:05.705 01:04:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:05.705 01:04:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:30:05.705 01:04:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:05.705 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:05.705 01:04:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:30:05.705 01:04:12 -- common/autotest_common.sh@10 -- # set +x 00:30:05.705 [2024-04-26 01:04:12.625632] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:30:05.705 [2024-04-26 01:04:12.625679] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:05.705 EAL: No free 2048 kB hugepages reported on node 1 00:30:05.705 [2024-04-26 01:04:12.676811] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:05.705 [2024-04-26 01:04:12.745206] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:05.705 [2024-04-26 01:04:12.745251] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:05.705 [2024-04-26 01:04:12.745257] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:30:05.705 [2024-04-26 01:04:12.745262] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:30:05.705 [2024-04-26 01:04:12.745267] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:05.705 [2024-04-26 01:04:12.745301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:05.705 [2024-04-26 01:04:12.745317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:05.705 [2024-04-26 01:04:12.745406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:05.705 [2024-04-26 01:04:12.745408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:06.303 01:04:13 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:30:06.303 01:04:13 -- common/autotest_common.sh@850 -- # return 0 00:30:06.303 01:04:13 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:30:06.303 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.303 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.303 [2024-04-26 01:04:13.430444] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ddf880/0x1de3d70) succeed. 00:30:06.303 [2024-04-26 01:04:13.439876] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1de0ec0/0x1e25400) succeed. 00:30:06.583 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.583 01:04:13 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:30:06.584 01:04:13 -- common/autotest_common.sh@716 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 01:04:13 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:30:06.584 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 Malloc1 00:30:06.584 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.584 01:04:13 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:06.584 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.584 01:04:13 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:30:06.584 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.584 01:04:13 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:30:06.584 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 [2024-04-26 01:04:13.633623] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:30:06.584 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.584 01:04:13 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:30:06.584 01:04:13 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:06.584 01:04:13 -- common/autotest_common.sh@10 -- # set +x 00:30:06.584 01:04:13 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:06.584 01:04:13 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:30:06.584 01:04:13 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:06.584 01:04:13 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:06.584 01:04:13 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:06.584 01:04:13 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:06.584 01:04:13 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:06.584 01:04:13 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:06.584 01:04:13 -- common/autotest_common.sh@1327 -- # shift 00:30:06.584 01:04:13 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:06.584 01:04:13 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:06.584 01:04:13 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:06.584 01:04:13 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:06.584 01:04:13 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:06.584 01:04:13 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:06.584 01:04:13 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:06.584 01:04:13 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:06.863 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:06.863 fio-3.35 00:30:06.863 Starting 1 thread 00:30:06.863 EAL: No free 2048 kB hugepages reported on node 1 00:30:09.580 00:30:09.580 test: (groupid=0, jobs=1): err= 0: pid=485310: Fri Apr 26 01:04:16 2024 00:30:09.581 read: IOPS=19.1k, BW=74.4MiB/s (78.0MB/s)(149MiB/2004msec) 00:30:09.581 slat (nsec): min=1285, max=29876, avg=1417.38, stdev=435.52 00:30:09.581 clat (usec): min=1863, max=6125, avg=3334.88, stdev=68.93 00:30:09.581 lat (usec): min=1893, max=6127, avg=3336.30, stdev=68.87 00:30:09.581 clat percentiles (usec): 00:30:09.581 | 1.00th=[ 3294], 5.00th=[ 3294], 10.00th=[ 3326], 20.00th=[ 3326], 00:30:09.581 | 30.00th=[ 3326], 40.00th=[ 3326], 50.00th=[ 3326], 60.00th=[ 3326], 00:30:09.581 | 70.00th=[ 3326], 80.00th=[ 3359], 90.00th=[ 3359], 95.00th=[ 3359], 00:30:09.581 | 99.00th=[ 3359], 99.50th=[ 3392], 99.90th=[ 3982], 99.95th=[ 4883], 00:30:09.581 | 99.99th=[ 6063] 00:30:09.581 bw ( KiB/s): min=74600, max=76960, per=100.00%, avg=76252.00, stdev=1108.68, samples=4 00:30:09.581 iops : min=18650, max=19240, avg=19063.00, stdev=277.17, samples=4 00:30:09.581 write: IOPS=19.0k, BW=74.4MiB/s (78.0MB/s)(149MiB/2004msec); 0 zone resets 00:30:09.581 slat (nsec): min=1340, max=19310, avg=1744.48, stdev=474.83 00:30:09.581 clat (usec): min=2459, max=6120, avg=3333.77, stdev=75.06 00:30:09.581 lat (usec): min=2463, max=6121, avg=3335.52, stdev=75.01 00:30:09.581 clat percentiles (usec): 00:30:09.581 | 1.00th=[ 3294], 5.00th=[ 3294], 10.00th=[ 3326], 20.00th=[ 3326], 00:30:09.581 | 30.00th=[ 3326], 40.00th=[ 3326], 50.00th=[ 3326], 60.00th=[ 3326], 00:30:09.581 | 70.00th=[ 3326], 80.00th=[ 3359], 90.00th=[ 3359], 95.00th=[ 3359], 00:30:09.581 | 99.00th=[ 3392], 99.50th=[ 3392], 99.90th=[ 4424], 99.95th=[ 5276], 00:30:09.581 | 99.99th=[ 6063] 00:30:09.581 bw ( KiB/s): min=74584, max=77040, per=100.00%, avg=76188.00, stdev=1113.05, samples=4 00:30:09.581 iops : min=18646, max=19260, avg=19047.00, stdev=278.26, samples=4 00:30:09.581 lat (msec) : 2=0.01%, 4=99.89%, 10=0.11% 00:30:09.581 cpu : usr=99.65%, sys=0.00%, ctx=15, majf=0, minf=3 00:30:09.581 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:30:09.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:09.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:09.581 issued rwts: total=38185,38162,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:09.581 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:09.581 00:30:09.581 Run status group 0 (all jobs): 00:30:09.581 READ: bw=74.4MiB/s (78.0MB/s), 74.4MiB/s-74.4MiB/s (78.0MB/s-78.0MB/s), io=149MiB (156MB), run=2004-2004msec 00:30:09.581 WRITE: bw=74.4MiB/s (78.0MB/s), 74.4MiB/s-74.4MiB/s (78.0MB/s-78.0MB/s), io=149MiB (156MB), run=2004-2004msec 00:30:09.581 01:04:16 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:09.581 01:04:16 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:09.581 01:04:16 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:09.581 01:04:16 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:09.581 01:04:16 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:09.581 01:04:16 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:09.581 01:04:16 -- common/autotest_common.sh@1327 -- # shift 00:30:09.581 01:04:16 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:09.581 01:04:16 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:09.581 01:04:16 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:09.581 01:04:16 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:09.581 01:04:16 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:09.581 01:04:16 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:09.581 01:04:16 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:09.581 01:04:16 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:30:09.581 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:30:09.581 fio-3.35 00:30:09.581 Starting 1 thread 00:30:09.581 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.109 00:30:12.109 test: (groupid=0, jobs=1): err= 0: pid=485949: Fri Apr 26 01:04:18 2024 00:30:12.109 read: IOPS=14.0k, BW=219MiB/s (230MB/s)(432MiB/1973msec) 00:30:12.109 slat (nsec): min=2126, max=35076, avg=2431.94, stdev=960.33 00:30:12.109 clat (usec): min=280, max=8066, avg=1655.93, stdev=1070.96 00:30:12.109 lat (usec): min=283, max=8081, avg=1658.36, stdev=1071.30 00:30:12.109 clat percentiles (usec): 00:30:12.109 | 1.00th=[ 562], 5.00th=[ 783], 10.00th=[ 898], 20.00th=[ 1045], 00:30:12.109 | 30.00th=[ 1156], 40.00th=[ 1237], 50.00th=[ 1336], 60.00th=[ 1450], 00:30:12.109 | 70.00th=[ 1614], 80.00th=[ 1876], 90.00th=[ 2540], 95.00th=[ 4621], 00:30:12.109 | 99.00th=[ 5866], 99.50th=[ 6390], 99.90th=[ 6980], 99.95th=[ 7242], 00:30:12.109 | 99.99th=[ 8029] 00:30:12.109 bw ( KiB/s): min=108064, max=114240, per=49.66%, avg=111376.00, stdev=2566.72, samples=4 00:30:12.109 iops : min= 6754, max= 7140, avg=6961.00, stdev=160.42, samples=4 00:30:12.109 write: IOPS=7838, BW=122MiB/s (128MB/s)(226MiB/1843msec); 0 zone resets 00:30:12.109 slat (usec): min=25, max=114, avg=28.38, stdev= 5.87 00:30:12.109 clat (usec): min=3787, max=20270, avg=12900.53, stdev=1599.55 00:30:12.109 lat (usec): min=3813, max=20298, avg=12928.91, stdev=1599.35 00:30:12.109 clat percentiles (usec): 00:30:12.109 | 1.00th=[ 7701], 5.00th=[10814], 10.00th=[11207], 20.00th=[11731], 00:30:12.109 | 30.00th=[12125], 40.00th=[12518], 50.00th=[12780], 60.00th=[13173], 00:30:12.109 | 70.00th=[13566], 80.00th=[13960], 90.00th=[14877], 95.00th=[15533], 00:30:12.109 | 99.00th=[16909], 99.50th=[17433], 99.90th=[19792], 99.95th=[20055], 00:30:12.109 | 99.99th=[20317] 00:30:12.109 bw ( KiB/s): min=109472, max=117760, per=91.38%, avg=114616.00, stdev=3696.83, samples=4 00:30:12.109 iops : min= 6842, max= 7360, avg=7163.50, stdev=231.05, samples=4 00:30:12.109 lat (usec) : 500=0.35%, 750=2.26%, 1000=8.36% 00:30:12.109 lat (msec) : 2=43.72%, 4=6.30%, 10=5.42%, 20=33.57%, 50=0.02% 00:30:12.109 cpu : usr=96.66%, sys=1.70%, ctx=185, majf=0, minf=2 00:30:12.109 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:30:12.109 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:12.109 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:12.109 issued rwts: total=27655,14447,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:12.109 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:12.109 00:30:12.109 Run status group 0 (all jobs): 00:30:12.109 READ: bw=219MiB/s (230MB/s), 219MiB/s-219MiB/s (230MB/s-230MB/s), io=432MiB (453MB), run=1973-1973msec 00:30:12.109 WRITE: bw=122MiB/s (128MB/s), 122MiB/s-122MiB/s (128MB/s-128MB/s), io=226MiB (237MB), run=1843-1843msec 00:30:12.109 01:04:18 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:12.109 01:04:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:12.109 01:04:18 -- common/autotest_common.sh@10 -- # set +x 00:30:12.109 01:04:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:12.109 01:04:18 -- host/fio.sh@47 -- # '[' 1 -eq 1 ']' 00:30:12.109 01:04:18 -- host/fio.sh@49 -- # bdfs=($(get_nvme_bdfs)) 00:30:12.109 01:04:18 -- host/fio.sh@49 -- # get_nvme_bdfs 00:30:12.109 01:04:18 -- common/autotest_common.sh@1499 -- # bdfs=() 00:30:12.109 01:04:18 -- common/autotest_common.sh@1499 -- # local bdfs 00:30:12.109 01:04:18 -- common/autotest_common.sh@1500 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:12.109 01:04:18 -- common/autotest_common.sh@1500 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:12.109 01:04:18 -- common/autotest_common.sh@1500 -- # jq -r '.config[].params.traddr' 00:30:12.109 01:04:19 -- common/autotest_common.sh@1501 -- # (( 1 == 0 )) 00:30:12.109 01:04:19 -- common/autotest_common.sh@1505 -- # printf '%s\n' 0000:d8:00.0 00:30:12.109 01:04:19 -- host/fio.sh@50 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:d8:00.0 -i 192.168.100.8 00:30:12.109 01:04:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:12.109 01:04:19 -- common/autotest_common.sh@10 -- # set +x 00:30:15.401 Nvme0n1 00:30:15.401 01:04:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:15.401 01:04:21 -- host/fio.sh@51 -- # rpc_cmd bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:30:15.401 01:04:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:15.401 01:04:21 -- common/autotest_common.sh@10 -- # set +x 00:30:25.380 01:04:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:25.380 01:04:32 -- host/fio.sh@51 -- # ls_guid=9c82a850-fe02-453c-b818-3e99adca5519 00:30:25.380 01:04:32 -- host/fio.sh@52 -- # get_lvs_free_mb 9c82a850-fe02-453c-b818-3e99adca5519 00:30:25.380 01:04:32 -- common/autotest_common.sh@1350 -- # local lvs_uuid=9c82a850-fe02-453c-b818-3e99adca5519 00:30:25.380 01:04:32 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:25.380 01:04:32 -- common/autotest_common.sh@1352 -- # local fc 00:30:25.380 01:04:32 -- common/autotest_common.sh@1353 -- # local cs 00:30:25.380 01:04:32 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:25.380 01:04:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:25.380 01:04:32 -- common/autotest_common.sh@10 -- # set +x 00:30:25.380 01:04:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:25.380 01:04:32 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:25.380 { 00:30:25.380 "uuid": "9c82a850-fe02-453c-b818-3e99adca5519", 00:30:25.380 "name": "lvs_0", 00:30:25.380 "base_bdev": "Nvme0n1", 00:30:25.380 "total_data_clusters": 3725, 00:30:25.380 "free_clusters": 3725, 00:30:25.380 "block_size": 512, 00:30:25.380 "cluster_size": 1073741824 00:30:25.380 } 00:30:25.380 ]' 00:30:25.380 01:04:32 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="9c82a850-fe02-453c-b818-3e99adca5519") .free_clusters' 00:30:25.380 01:04:32 -- common/autotest_common.sh@1355 -- # fc=3725 00:30:25.380 01:04:32 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="9c82a850-fe02-453c-b818-3e99adca5519") .cluster_size' 00:30:25.639 01:04:32 -- common/autotest_common.sh@1356 -- # cs=1073741824 00:30:25.639 01:04:32 -- common/autotest_common.sh@1359 -- # free_mb=3814400 00:30:25.639 01:04:32 -- common/autotest_common.sh@1360 -- # echo 3814400 00:30:25.639 3814400 00:30:25.639 01:04:32 -- host/fio.sh@53 -- # rpc_cmd bdev_lvol_create -l lvs_0 lbd_0 3814400 00:30:25.639 01:04:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:25.639 01:04:32 -- common/autotest_common.sh@10 -- # set +x 00:30:26.206 4222f13b-7b4f-49ca-9c64-49af1cae7d08 00:30:26.206 01:04:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:26.206 01:04:33 -- host/fio.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:30:26.206 01:04:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:26.206 01:04:33 -- common/autotest_common.sh@10 -- # set +x 00:30:26.206 01:04:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:26.206 01:04:33 -- host/fio.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:30:26.206 01:04:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:26.206 01:04:33 -- common/autotest_common.sh@10 -- # set +x 00:30:26.206 01:04:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:26.206 01:04:33 -- host/fio.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:30:26.206 01:04:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:26.206 01:04:33 -- common/autotest_common.sh@10 -- # set +x 00:30:26.206 01:04:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:26.206 01:04:33 -- host/fio.sh@57 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:26.206 01:04:33 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:26.206 01:04:33 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:26.206 01:04:33 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:26.206 01:04:33 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:26.206 01:04:33 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:26.206 01:04:33 -- common/autotest_common.sh@1327 -- # shift 00:30:26.206 01:04:33 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:26.206 01:04:33 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:26.206 01:04:33 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:26.206 01:04:33 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:26.206 01:04:33 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:26.206 01:04:33 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:26.206 01:04:33 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:26.206 01:04:33 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:26.464 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:26.464 fio-3.35 00:30:26.464 Starting 1 thread 00:30:26.464 EAL: No free 2048 kB hugepages reported on node 1 00:30:29.003 00:30:29.003 test: (groupid=0, jobs=1): err= 0: pid=489065: Fri Apr 26 01:04:36 2024 00:30:29.003 read: IOPS=6894, BW=26.9MiB/s (28.2MB/s)(54.0MiB/2005msec) 00:30:29.003 slat (nsec): min=1291, max=18699, avg=1393.67, stdev=211.17 00:30:29.003 clat (usec): min=159, max=885954, avg=9280.14, stdev=60580.11 00:30:29.003 lat (usec): min=160, max=885969, avg=9281.53, stdev=60580.18 00:30:29.003 clat percentiles (msec): 00:30:29.003 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:30:29.003 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:30:29.003 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:29.003 | 99.00th=[ 6], 99.50th=[ 9], 99.90th=[ 885], 99.95th=[ 885], 00:30:29.003 | 99.99th=[ 885] 00:30:29.003 bw ( KiB/s): min= 384, max=50128, per=99.81%, avg=27524.00, stdev=26337.64, samples=4 00:30:29.003 iops : min= 96, max=12532, avg=6881.00, stdev=6584.41, samples=4 00:30:29.003 write: IOPS=6901, BW=27.0MiB/s (28.3MB/s)(54.1MiB/2005msec); 0 zone resets 00:30:29.003 slat (nsec): min=1344, max=5510, avg=1726.73, stdev=237.62 00:30:29.003 clat (usec): min=335, max=886230, avg=9058.87, stdev=58684.43 00:30:29.003 lat (usec): min=337, max=886234, avg=9060.60, stdev=58684.48 00:30:29.003 clat percentiles (msec): 00:30:29.003 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:30:29.003 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 6], 00:30:29.003 | 70.00th=[ 6], 80.00th=[ 6], 90.00th=[ 6], 95.00th=[ 6], 00:30:29.004 | 99.00th=[ 6], 99.50th=[ 9], 99.90th=[ 885], 99.95th=[ 885], 00:30:29.004 | 99.99th=[ 885] 00:30:29.004 bw ( KiB/s): min= 416, max=50232, per=99.77%, avg=27544.00, stdev=26201.60, samples=4 00:30:29.004 iops : min= 104, max=12558, avg=6886.00, stdev=6550.40, samples=4 00:30:29.004 lat (usec) : 250=0.01%, 500=0.02%, 750=0.01%, 1000=0.03% 00:30:29.004 lat (msec) : 2=0.05%, 4=0.38%, 10=99.05%, 1000=0.46% 00:30:29.004 cpu : usr=99.55%, sys=0.10%, ctx=16, majf=0, minf=21 00:30:29.004 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:30:29.004 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:29.004 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:29.004 issued rwts: total=13823,13838,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:29.004 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:29.004 00:30:29.004 Run status group 0 (all jobs): 00:30:29.004 READ: bw=26.9MiB/s (28.2MB/s), 26.9MiB/s-26.9MiB/s (28.2MB/s-28.2MB/s), io=54.0MiB (56.6MB), run=2005-2005msec 00:30:29.004 WRITE: bw=27.0MiB/s (28.3MB/s), 27.0MiB/s-27.0MiB/s (28.3MB/s-28.3MB/s), io=54.1MiB (56.7MB), run=2005-2005msec 00:30:29.004 01:04:36 -- host/fio.sh@59 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:30:29.004 01:04:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:29.004 01:04:36 -- common/autotest_common.sh@10 -- # set +x 00:30:29.004 01:04:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:29.004 01:04:36 -- host/fio.sh@62 -- # rpc_cmd bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:30:29.004 01:04:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:29.004 01:04:36 -- common/autotest_common.sh@10 -- # set +x 00:30:31.541 01:04:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:31.541 01:04:38 -- host/fio.sh@62 -- # ls_nested_guid=a9449ed4-7ad2-4b55-b8f5-e85703548d0a 00:30:31.541 01:04:38 -- host/fio.sh@63 -- # get_lvs_free_mb a9449ed4-7ad2-4b55-b8f5-e85703548d0a 00:30:31.541 01:04:38 -- common/autotest_common.sh@1350 -- # local lvs_uuid=a9449ed4-7ad2-4b55-b8f5-e85703548d0a 00:30:31.541 01:04:38 -- common/autotest_common.sh@1351 -- # local lvs_info 00:30:31.541 01:04:38 -- common/autotest_common.sh@1352 -- # local fc 00:30:31.541 01:04:38 -- common/autotest_common.sh@1353 -- # local cs 00:30:31.541 01:04:38 -- common/autotest_common.sh@1354 -- # rpc_cmd bdev_lvol_get_lvstores 00:30:31.541 01:04:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:31.541 01:04:38 -- common/autotest_common.sh@10 -- # set +x 00:30:31.541 01:04:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:31.541 01:04:38 -- common/autotest_common.sh@1354 -- # lvs_info='[ 00:30:31.541 { 00:30:31.541 "uuid": "9c82a850-fe02-453c-b818-3e99adca5519", 00:30:31.541 "name": "lvs_0", 00:30:31.541 "base_bdev": "Nvme0n1", 00:30:31.541 "total_data_clusters": 3725, 00:30:31.541 "free_clusters": 0, 00:30:31.541 "block_size": 512, 00:30:31.541 "cluster_size": 1073741824 00:30:31.541 }, 00:30:31.541 { 00:30:31.541 "uuid": "a9449ed4-7ad2-4b55-b8f5-e85703548d0a", 00:30:31.541 "name": "lvs_n_0", 00:30:31.541 "base_bdev": "4222f13b-7b4f-49ca-9c64-49af1cae7d08", 00:30:31.541 "total_data_clusters": 952668, 00:30:31.541 "free_clusters": 952668, 00:30:31.541 "block_size": 512, 00:30:31.541 "cluster_size": 4194304 00:30:31.541 } 00:30:31.541 ]' 00:30:31.541 01:04:38 -- common/autotest_common.sh@1355 -- # jq '.[] | select(.uuid=="a9449ed4-7ad2-4b55-b8f5-e85703548d0a") .free_clusters' 00:30:31.541 01:04:38 -- common/autotest_common.sh@1355 -- # fc=952668 00:30:31.541 01:04:38 -- common/autotest_common.sh@1356 -- # jq '.[] | select(.uuid=="a9449ed4-7ad2-4b55-b8f5-e85703548d0a") .cluster_size' 00:30:31.541 01:04:38 -- common/autotest_common.sh@1356 -- # cs=4194304 00:30:31.541 01:04:38 -- common/autotest_common.sh@1359 -- # free_mb=3810672 00:30:31.541 01:04:38 -- common/autotest_common.sh@1360 -- # echo 3810672 00:30:31.541 3810672 00:30:31.541 01:04:38 -- host/fio.sh@64 -- # rpc_cmd bdev_lvol_create -l lvs_n_0 lbd_nest_0 3810672 00:30:31.541 01:04:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:31.541 01:04:38 -- common/autotest_common.sh@10 -- # set +x 00:30:32.480 64225169-9d17-4fa9-9095-04b667076b1c 00:30:32.480 01:04:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:32.480 01:04:39 -- host/fio.sh@65 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:30:32.480 01:04:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:32.480 01:04:39 -- common/autotest_common.sh@10 -- # set +x 00:30:32.480 01:04:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:32.480 01:04:39 -- host/fio.sh@66 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:30:32.480 01:04:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:32.480 01:04:39 -- common/autotest_common.sh@10 -- # set +x 00:30:32.480 01:04:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:32.480 01:04:39 -- host/fio.sh@67 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:30:32.480 01:04:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:32.480 01:04:39 -- common/autotest_common.sh@10 -- # set +x 00:30:32.480 01:04:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:32.480 01:04:39 -- host/fio.sh@68 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:32.480 01:04:39 -- common/autotest_common.sh@1346 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:32.480 01:04:39 -- common/autotest_common.sh@1323 -- # local fio_dir=/usr/src/fio 00:30:32.480 01:04:39 -- common/autotest_common.sh@1325 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:32.480 01:04:39 -- common/autotest_common.sh@1325 -- # local sanitizers 00:30:32.480 01:04:39 -- common/autotest_common.sh@1326 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:32.480 01:04:39 -- common/autotest_common.sh@1327 -- # shift 00:30:32.480 01:04:39 -- common/autotest_common.sh@1329 -- # local asan_lib= 00:30:32.480 01:04:39 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:32.480 01:04:39 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:32.480 01:04:39 -- common/autotest_common.sh@1331 -- # grep libasan 00:30:32.480 01:04:39 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:32.480 01:04:39 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:32.481 01:04:39 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:32.481 01:04:39 -- common/autotest_common.sh@1330 -- # for sanitizer in "${sanitizers[@]}" 00:30:32.481 01:04:39 -- common/autotest_common.sh@1331 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:30:32.481 01:04:39 -- common/autotest_common.sh@1331 -- # grep libclang_rt.asan 00:30:32.481 01:04:39 -- common/autotest_common.sh@1331 -- # awk '{print $3}' 00:30:32.741 01:04:39 -- common/autotest_common.sh@1331 -- # asan_lib= 00:30:32.741 01:04:39 -- common/autotest_common.sh@1332 -- # [[ -n '' ]] 00:30:32.741 01:04:39 -- common/autotest_common.sh@1338 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:30:32.741 01:04:39 -- common/autotest_common.sh@1338 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:30:33.000 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:30:33.000 fio-3.35 00:30:33.000 Starting 1 thread 00:30:33.000 EAL: No free 2048 kB hugepages reported on node 1 00:30:35.538 00:30:35.538 test: (groupid=0, jobs=1): err= 0: pid=490406: Fri Apr 26 01:04:42 2024 00:30:35.538 read: IOPS=10.4k, BW=40.8MiB/s (42.7MB/s)(81.7MiB/2006msec) 00:30:35.538 slat (nsec): min=1293, max=24116, avg=1397.13, stdev=356.98 00:30:35.538 clat (usec): min=2601, max=10019, avg=6029.08, stdev=164.56 00:30:35.538 lat (usec): min=2606, max=10020, avg=6030.47, stdev=164.53 00:30:35.538 clat percentiles (usec): 00:30:35.538 | 1.00th=[ 5932], 5.00th=[ 5932], 10.00th=[ 5997], 20.00th=[ 5997], 00:30:35.538 | 30.00th=[ 5997], 40.00th=[ 5997], 50.00th=[ 5997], 60.00th=[ 6063], 00:30:35.538 | 70.00th=[ 6063], 80.00th=[ 6063], 90.00th=[ 6063], 95.00th=[ 6063], 00:30:35.538 | 99.00th=[ 6194], 99.50th=[ 6259], 99.90th=[ 8455], 99.95th=[ 9896], 00:30:35.538 | 99.99th=[10028] 00:30:35.538 bw ( KiB/s): min=39592, max=42712, per=100.00%, avg=41728.00, stdev=1439.44, samples=4 00:30:35.538 iops : min= 9898, max=10678, avg=10432.00, stdev=359.86, samples=4 00:30:35.538 write: IOPS=10.4k, BW=40.8MiB/s (42.7MB/s)(81.8MiB/2006msec); 0 zone resets 00:30:35.538 slat (nsec): min=1342, max=17404, avg=1743.11, stdev=370.52 00:30:35.538 clat (usec): min=2581, max=10013, avg=6049.52, stdev=161.87 00:30:35.538 lat (usec): min=2585, max=10014, avg=6051.26, stdev=161.85 00:30:35.538 clat percentiles (usec): 00:30:35.538 | 1.00th=[ 5932], 5.00th=[ 5997], 10.00th=[ 5997], 20.00th=[ 5997], 00:30:35.538 | 30.00th=[ 6063], 40.00th=[ 6063], 50.00th=[ 6063], 60.00th=[ 6063], 00:30:35.538 | 70.00th=[ 6063], 80.00th=[ 6063], 90.00th=[ 6063], 95.00th=[ 6128], 00:30:35.538 | 99.00th=[ 6194], 99.50th=[ 6259], 99.90th=[ 8455], 99.95th=[ 9896], 00:30:35.538 | 99.99th=[10028] 00:30:35.538 bw ( KiB/s): min=40024, max=42536, per=99.99%, avg=41738.00, stdev=1158.88, samples=4 00:30:35.538 iops : min=10006, max=10634, avg=10434.50, stdev=289.72, samples=4 00:30:35.538 lat (msec) : 4=0.02%, 10=99.97%, 20=0.01% 00:30:35.538 cpu : usr=99.70%, sys=0.00%, ctx=16, majf=0, minf=21 00:30:35.538 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:30:35.538 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:30:35.538 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:30:35.538 issued rwts: total=20927,20933,0,0 short=0,0,0,0 dropped=0,0,0,0 00:30:35.538 latency : target=0, window=0, percentile=100.00%, depth=128 00:30:35.538 00:30:35.538 Run status group 0 (all jobs): 00:30:35.538 READ: bw=40.8MiB/s (42.7MB/s), 40.8MiB/s-40.8MiB/s (42.7MB/s-42.7MB/s), io=81.7MiB (85.7MB), run=2006-2006msec 00:30:35.538 WRITE: bw=40.8MiB/s (42.7MB/s), 40.8MiB/s-40.8MiB/s (42.7MB/s-42.7MB/s), io=81.8MiB (85.7MB), run=2006-2006msec 00:30:35.538 01:04:42 -- host/fio.sh@70 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:30:35.538 01:04:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:35.538 01:04:42 -- common/autotest_common.sh@10 -- # set +x 00:30:35.538 01:04:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:35.538 01:04:42 -- host/fio.sh@72 -- # sync 00:30:35.538 01:04:42 -- host/fio.sh@74 -- # rpc_cmd bdev_lvol_delete lvs_n_0/lbd_nest_0 00:30:35.538 01:04:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:35.538 01:04:42 -- common/autotest_common.sh@10 -- # set +x 00:30:50.424 01:04:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:50.424 01:04:56 -- host/fio.sh@75 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_n_0 00:30:50.424 01:04:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:50.424 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:30:50.424 01:04:56 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:30:50.425 01:04:56 -- host/fio.sh@76 -- # rpc_cmd bdev_lvol_delete lvs_0/lbd_0 00:30:50.425 01:04:56 -- common/autotest_common.sh@549 -- # xtrace_disable 00:30:50.425 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:31:00.427 01:05:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.427 01:05:07 -- host/fio.sh@77 -- # rpc_cmd bdev_lvol_delete_lvstore -l lvs_0 00:31:00.427 01:05:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.427 01:05:07 -- common/autotest_common.sh@10 -- # set +x 00:31:00.427 01:05:07 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:00.427 01:05:07 -- host/fio.sh@78 -- # rpc_cmd bdev_nvme_detach_controller Nvme0 00:31:00.427 01:05:07 -- common/autotest_common.sh@549 -- # xtrace_disable 00:31:00.427 01:05:07 -- common/autotest_common.sh@10 -- # set +x 00:31:05.718 01:05:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:31:05.718 01:05:12 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:31:05.718 01:05:12 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:31:05.718 01:05:12 -- host/fio.sh@84 -- # nvmftestfini 00:31:05.718 01:05:12 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:05.718 01:05:12 -- nvmf/common.sh@117 -- # sync 00:31:05.718 01:05:12 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:05.718 01:05:12 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:05.718 01:05:12 -- nvmf/common.sh@120 -- # set +e 00:31:05.718 01:05:12 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:05.718 01:05:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:05.718 rmmod nvme_rdma 00:31:05.718 rmmod nvme_fabrics 00:31:05.718 01:05:12 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:05.718 01:05:12 -- nvmf/common.sh@124 -- # set -e 00:31:05.718 01:05:12 -- nvmf/common.sh@125 -- # return 0 00:31:05.718 01:05:12 -- nvmf/common.sh@478 -- # '[' -n 484869 ']' 00:31:05.718 01:05:12 -- nvmf/common.sh@479 -- # killprocess 484869 00:31:05.718 01:05:12 -- common/autotest_common.sh@936 -- # '[' -z 484869 ']' 00:31:05.718 01:05:12 -- common/autotest_common.sh@940 -- # kill -0 484869 00:31:05.718 01:05:12 -- common/autotest_common.sh@941 -- # uname 00:31:05.718 01:05:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:05.718 01:05:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 484869 00:31:05.718 01:05:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:05.718 01:05:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:05.718 01:05:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 484869' 00:31:05.718 killing process with pid 484869 00:31:05.718 01:05:12 -- common/autotest_common.sh@955 -- # kill 484869 00:31:05.718 01:05:12 -- common/autotest_common.sh@960 -- # wait 484869 00:31:05.719 [2024-04-26 01:05:12.559047] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:31:05.719 01:05:12 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:05.719 01:05:12 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:05.719 00:31:05.719 real 1m5.594s 00:31:05.719 user 4m41.338s 00:31:05.719 sys 0m5.429s 00:31:05.719 01:05:12 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:05.719 01:05:12 -- common/autotest_common.sh@10 -- # set +x 00:31:05.719 ************************************ 00:31:05.719 END TEST nvmf_fio_host 00:31:05.719 ************************************ 00:31:05.719 01:05:12 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:31:05.719 01:05:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:05.719 01:05:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:05.719 01:05:12 -- common/autotest_common.sh@10 -- # set +x 00:31:05.978 ************************************ 00:31:05.978 START TEST nvmf_failover 00:31:05.978 ************************************ 00:31:05.978 01:05:12 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:31:05.978 * Looking for test storage... 00:31:05.978 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:05.978 01:05:13 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:05.978 01:05:13 -- nvmf/common.sh@7 -- # uname -s 00:31:05.978 01:05:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:05.978 01:05:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:05.978 01:05:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:05.978 01:05:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:05.978 01:05:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:05.978 01:05:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:05.978 01:05:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:05.978 01:05:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:05.978 01:05:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:05.978 01:05:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:05.978 01:05:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:05.978 01:05:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:05.978 01:05:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:05.978 01:05:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:05.978 01:05:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:05.978 01:05:13 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:05.978 01:05:13 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:05.978 01:05:13 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:05.978 01:05:13 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:05.979 01:05:13 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:05.979 01:05:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.979 01:05:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.979 01:05:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.979 01:05:13 -- paths/export.sh@5 -- # export PATH 00:31:05.979 01:05:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.979 01:05:13 -- nvmf/common.sh@47 -- # : 0 00:31:05.979 01:05:13 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:05.979 01:05:13 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:05.979 01:05:13 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:05.979 01:05:13 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:05.979 01:05:13 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:05.979 01:05:13 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:05.979 01:05:13 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:05.979 01:05:13 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:05.979 01:05:13 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:31:05.979 01:05:13 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:31:05.979 01:05:13 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:31:05.979 01:05:13 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:31:05.979 01:05:13 -- host/failover.sh@18 -- # nvmftestinit 00:31:05.979 01:05:13 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:05.979 01:05:13 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:05.979 01:05:13 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:05.979 01:05:13 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:05.979 01:05:13 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:05.979 01:05:13 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:05.979 01:05:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:05.979 01:05:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:05.979 01:05:13 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:05.979 01:05:13 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:05.979 01:05:13 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:05.979 01:05:13 -- common/autotest_common.sh@10 -- # set +x 00:31:11.260 01:05:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:11.260 01:05:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:11.260 01:05:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:11.260 01:05:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:11.260 01:05:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:11.260 01:05:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:11.260 01:05:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:11.260 01:05:17 -- nvmf/common.sh@295 -- # net_devs=() 00:31:11.260 01:05:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:11.260 01:05:17 -- nvmf/common.sh@296 -- # e810=() 00:31:11.260 01:05:17 -- nvmf/common.sh@296 -- # local -ga e810 00:31:11.260 01:05:17 -- nvmf/common.sh@297 -- # x722=() 00:31:11.260 01:05:17 -- nvmf/common.sh@297 -- # local -ga x722 00:31:11.260 01:05:17 -- nvmf/common.sh@298 -- # mlx=() 00:31:11.260 01:05:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:11.260 01:05:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:11.260 01:05:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:11.260 01:05:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:11.260 01:05:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:11.260 01:05:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:11.260 01:05:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:31:11.260 01:05:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:31:11.260 01:05:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:11.260 01:05:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:31:11.261 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:31:11.261 01:05:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:11.261 01:05:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:31:11.261 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:31:11.261 01:05:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:11.261 01:05:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:11.261 01:05:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:11.261 01:05:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:31:11.261 Found net devices under 0000:18:00.0: mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:11.261 01:05:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:11.261 01:05:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:11.261 01:05:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:31:11.261 Found net devices under 0000:18:00.1: mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:11.261 01:05:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:11.261 01:05:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:11.261 01:05:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:11.261 01:05:17 -- nvmf/common.sh@58 -- # uname 00:31:11.261 01:05:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:11.261 01:05:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:11.261 01:05:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:11.261 01:05:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:11.261 01:05:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:11.261 01:05:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:11.261 01:05:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:11.261 01:05:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:11.261 01:05:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:11.261 01:05:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:11.261 01:05:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:11.261 01:05:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:11.261 01:05:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:11.261 01:05:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:11.261 01:05:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:11.261 01:05:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@105 -- # continue 2 00:31:11.261 01:05:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@105 -- # continue 2 00:31:11.261 01:05:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:11.261 01:05:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:11.261 01:05:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:11.261 01:05:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:31:11.261 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:11.261 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:31:11.261 altname enp24s0f0np0 00:31:11.261 altname ens785f0np0 00:31:11.261 inet 192.168.100.8/24 scope global mlx_0_0 00:31:11.261 valid_lft forever preferred_lft forever 00:31:11.261 01:05:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:11.261 01:05:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:11.261 01:05:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:11.261 01:05:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:31:11.261 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:11.261 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:31:11.261 altname enp24s0f1np1 00:31:11.261 altname ens785f1np1 00:31:11.261 inet 192.168.100.9/24 scope global mlx_0_1 00:31:11.261 valid_lft forever preferred_lft forever 00:31:11.261 01:05:17 -- nvmf/common.sh@411 -- # return 0 00:31:11.261 01:05:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:11.261 01:05:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:11.261 01:05:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:11.261 01:05:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:11.261 01:05:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:11.261 01:05:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:11.261 01:05:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:11.261 01:05:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:11.261 01:05:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:11.261 01:05:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@105 -- # continue 2 00:31:11.261 01:05:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:11.261 01:05:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:11.261 01:05:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@105 -- # continue 2 00:31:11.261 01:05:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:11.261 01:05:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:11.261 01:05:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:11.261 01:05:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:11.261 01:05:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:11.261 01:05:17 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:11.261 192.168.100.9' 00:31:11.261 01:05:17 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:11.261 192.168.100.9' 00:31:11.261 01:05:17 -- nvmf/common.sh@446 -- # head -n 1 00:31:11.261 01:05:17 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:11.261 01:05:17 -- nvmf/common.sh@447 -- # tail -n +2 00:31:11.261 01:05:17 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:11.261 192.168.100.9' 00:31:11.261 01:05:17 -- nvmf/common.sh@447 -- # head -n 1 00:31:11.261 01:05:17 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:11.261 01:05:17 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:11.261 01:05:17 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:11.261 01:05:17 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:11.261 01:05:17 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:11.261 01:05:17 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:11.261 01:05:17 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:31:11.261 01:05:17 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:31:11.261 01:05:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:31:11.261 01:05:17 -- common/autotest_common.sh@10 -- # set +x 00:31:11.261 01:05:17 -- nvmf/common.sh@470 -- # nvmfpid=499127 00:31:11.261 01:05:17 -- nvmf/common.sh@471 -- # waitforlisten 499127 00:31:11.261 01:05:17 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:31:11.261 01:05:17 -- common/autotest_common.sh@817 -- # '[' -z 499127 ']' 00:31:11.261 01:05:17 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:11.261 01:05:17 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:11.261 01:05:17 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:11.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:11.262 01:05:17 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:11.262 01:05:17 -- common/autotest_common.sh@10 -- # set +x 00:31:11.262 [2024-04-26 01:05:17.977076] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:31:11.262 [2024-04-26 01:05:17.977131] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:11.262 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.262 [2024-04-26 01:05:18.029635] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:31:11.262 [2024-04-26 01:05:18.099560] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:11.262 [2024-04-26 01:05:18.099600] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:11.262 [2024-04-26 01:05:18.099606] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:31:11.262 [2024-04-26 01:05:18.099611] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:31:11.262 [2024-04-26 01:05:18.099615] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:11.262 [2024-04-26 01:05:18.099736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:11.262 [2024-04-26 01:05:18.099832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:11.262 [2024-04-26 01:05:18.099833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:11.830 01:05:18 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:11.830 01:05:18 -- common/autotest_common.sh@850 -- # return 0 00:31:11.830 01:05:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:31:11.830 01:05:18 -- common/autotest_common.sh@716 -- # xtrace_disable 00:31:11.830 01:05:18 -- common/autotest_common.sh@10 -- # set +x 00:31:11.830 01:05:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:11.830 01:05:18 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:31:11.830 [2024-04-26 01:05:18.962207] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x20ec080/0x20f0570) succeed. 00:31:11.830 [2024-04-26 01:05:18.971001] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x20ed620/0x2131c00) succeed. 00:31:12.090 01:05:19 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:31:12.090 Malloc0 00:31:12.090 01:05:19 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:31:12.349 01:05:19 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:31:12.608 01:05:19 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:12.608 [2024-04-26 01:05:19.736211] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:31:12.608 01:05:19 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:12.867 [2024-04-26 01:05:19.896488] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:31:12.867 01:05:19 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:13.128 [2024-04-26 01:05:20.061076] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:31:13.128 01:05:20 -- host/failover.sh@31 -- # bdevperf_pid=499432 00:31:13.128 01:05:20 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:31:13.128 01:05:20 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:13.128 01:05:20 -- host/failover.sh@34 -- # waitforlisten 499432 /var/tmp/bdevperf.sock 00:31:13.128 01:05:20 -- common/autotest_common.sh@817 -- # '[' -z 499432 ']' 00:31:13.128 01:05:20 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:31:13.128 01:05:20 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:13.128 01:05:20 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:31:13.128 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:31:13.128 01:05:20 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:13.128 01:05:20 -- common/autotest_common.sh@10 -- # set +x 00:31:14.067 01:05:20 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:14.067 01:05:20 -- common/autotest_common.sh@850 -- # return 0 00:31:14.067 01:05:20 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:14.067 NVMe0n1 00:31:14.067 01:05:21 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:14.326 00:31:14.327 01:05:21 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:31:14.327 01:05:21 -- host/failover.sh@39 -- # run_test_pid=499697 00:31:14.327 01:05:21 -- host/failover.sh@41 -- # sleep 1 00:31:15.266 01:05:22 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:15.525 01:05:22 -- host/failover.sh@45 -- # sleep 3 00:31:18.817 01:05:25 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:18.817 00:31:18.817 01:05:25 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:18.817 01:05:25 -- host/failover.sh@50 -- # sleep 3 00:31:22.110 01:05:28 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:31:22.110 [2024-04-26 01:05:29.056312] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:31:22.110 01:05:29 -- host/failover.sh@55 -- # sleep 1 00:31:23.048 01:05:30 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:23.307 01:05:30 -- host/failover.sh@59 -- # wait 499697 00:31:29.885 0 00:31:29.885 01:05:36 -- host/failover.sh@61 -- # killprocess 499432 00:31:29.885 01:05:36 -- common/autotest_common.sh@936 -- # '[' -z 499432 ']' 00:31:29.885 01:05:36 -- common/autotest_common.sh@940 -- # kill -0 499432 00:31:29.885 01:05:36 -- common/autotest_common.sh@941 -- # uname 00:31:29.885 01:05:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:29.885 01:05:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 499432 00:31:29.885 01:05:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:29.885 01:05:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:29.885 01:05:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 499432' 00:31:29.885 killing process with pid 499432 00:31:29.885 01:05:36 -- common/autotest_common.sh@955 -- # kill 499432 00:31:29.885 01:05:36 -- common/autotest_common.sh@960 -- # wait 499432 00:31:29.885 01:05:36 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:29.885 [2024-04-26 01:05:20.126860] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:31:29.885 [2024-04-26 01:05:20.126911] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid499432 ] 00:31:29.885 EAL: No free 2048 kB hugepages reported on node 1 00:31:29.885 [2024-04-26 01:05:20.178749] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:29.885 [2024-04-26 01:05:20.244963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:29.885 Running I/O for 15 seconds... 00:31:29.885 [2024-04-26 01:05:23.504617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:37136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:37144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:37152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:37168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:37176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.885 [2024-04-26 01:05:23.504732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.885 [2024-04-26 01:05:23.504739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:37200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:37216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:37224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:37232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:37240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:37256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:37264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:37280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:37296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:37312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:37320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:37328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.504988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.504996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:37336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:37352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:37360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:37368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:37376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:37392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:37400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:37408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:37416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:37424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:37432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:37440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:37456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:37464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:37472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.886 [2024-04-26 01:05:23.505259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:37496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.886 [2024-04-26 01:05:23.505265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:37504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:37520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:37528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:37544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:37560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:37568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:37576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:37584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:37592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:37608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:37624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:37632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:37640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:37648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:37656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:37696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:37712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:37720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:37728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:37752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:37760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:37768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:37792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:37808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.887 [2024-04-26 01:05:23.505781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.887 [2024-04-26 01:05:23.505786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:37832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:37840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:37848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:37856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:37864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:37880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.888 [2024-04-26 01:05:23.505891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:36864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:36872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:36880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:36912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.505991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:36920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.505997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:36936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:36952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:36976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:36984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:37000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:37008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:37016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:37024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:37032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:37040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:37056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:37064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:37072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.888 [2024-04-26 01:05:23.506271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:37088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187200 00:31:29.888 [2024-04-26 01:05:23.506276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.506283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:37096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:23.506289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.506296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:37104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:23.506302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.506309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:37112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:23.506315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.506322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:37120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:23.506328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.508196] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:29.889 [2024-04-26 01:05:23.508206] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:29.889 [2024-04-26 01:05:23.508213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:37128 len:8 PRP1 0x0 PRP2 0x0 00:31:29.889 [2024-04-26 01:05:23.508221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:23.508260] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:31:29.889 [2024-04-26 01:05:23.508268] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:29.889 [2024-04-26 01:05:23.508275] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:29.889 [2024-04-26 01:05:23.510809] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:29.889 [2024-04-26 01:05:23.524798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:29.889 [2024-04-26 01:05:23.559467] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:29.889 [2024-04-26 01:05:26.897839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:17808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:17816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:17824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:17832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:17840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:17848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:17856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:17864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.897993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:17872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.897999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:17880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:17888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:17904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:17280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:17912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:17920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:17928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:17944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:17952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:17968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.889 [2024-04-26 01:05:26.898184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:17288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:17312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:17320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:17328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187200 00:31:29.889 [2024-04-26 01:05:26.898281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.889 [2024-04-26 01:05:26.898288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:17344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:17352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:17360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:17376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:17384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:17392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:17400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:17408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:17424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:17432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:17448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:17464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:17480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:17496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:17528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:17536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:17544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:17552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:17560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752a000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:17568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007528000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:17576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187200 00:31:29.890 [2024-04-26 01:05:26.898679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.890 [2024-04-26 01:05:26.898686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:17584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:17592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:17600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:17608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:17616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:17640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:17648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:17664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:17672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:17704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:17712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:17720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:17728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187200 00:31:29.891 [2024-04-26 01:05:26.898933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:17976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.898946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:17984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.898959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:17992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.898972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:18000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.898985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.898992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:18008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.898997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:18016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:18024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:18032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:18040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:18056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:18072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:18080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:18088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:18112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:18120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.891 [2024-04-26 01:05:26.899190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:18128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.891 [2024-04-26 01:05:26.899195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:18144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:18152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:17736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:17744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:18168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:18184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:18200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:18208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:18216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:17752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:17776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:17784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:26.899463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:18232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:18240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:18248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:18256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:18264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:18280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.899563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:18288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:26.899568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.901281] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:29.892 [2024-04-26 01:05:26.901292] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:29.892 [2024-04-26 01:05:26.901298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17800 len:8 PRP1 0x0 PRP2 0x0 00:31:29.892 [2024-04-26 01:05:26.901304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:26.901341] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:29.892 [2024-04-26 01:05:26.901348] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:31:29.892 [2024-04-26 01:05:26.901354] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:29.892 [2024-04-26 01:05:26.903891] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:29.892 [2024-04-26 01:05:26.917794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:29.892 [2024-04-26 01:05:26.965592] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:29.892 [2024-04-26 01:05:31.245528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:24480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:31.245566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:31.245580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:24488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.892 [2024-04-26 01:05:31.245587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:31.245595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:31.245606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:31.245613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:23672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:31.245619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:31.245627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:23680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:31.245633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.892 [2024-04-26 01:05:31.245640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x187200 00:31:29.892 [2024-04-26 01:05:31.245646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:23696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:23712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:23736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:23752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:23760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:23768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:23776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:23784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:23800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:23824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:23832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:23848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007524000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:23864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007526000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:23880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:23896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.245991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.245999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:23904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:24496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.893 [2024-04-26 01:05:31.246032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:24504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.893 [2024-04-26 01:05:31.246045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:24512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.893 [2024-04-26 01:05:31.246058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.893 [2024-04-26 01:05:31.246072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:23920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752c000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000752e000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:23936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007530000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:23944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007532000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.893 [2024-04-26 01:05:31.246132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007534000 len:0x1000 key:0x187200 00:31:29.893 [2024-04-26 01:05:31.246138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007536000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:23968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007538000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:23976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:23984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:23992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:24000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:24008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:24032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:24048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:24056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:24080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:24088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:24104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:24112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:24136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:24152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:24160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x187200 00:31:29.894 [2024-04-26 01:05:31.246495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:24528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.894 [2024-04-26 01:05:31.246507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:24536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.894 [2024-04-26 01:05:31.246522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:24544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.894 [2024-04-26 01:05:31.246535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.894 [2024-04-26 01:05:31.246548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.894 [2024-04-26 01:05:31.246555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:24176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:24200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:24208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:24216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007518000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751a000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:24232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751c000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:24560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:24568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:24576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:24592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:24600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:24608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:24248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750a000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007508000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:24264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007500000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007512000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:24280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007514000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007516000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:24296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:24624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:24632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:24640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:24648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.246918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007502000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007504000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:24320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007506000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:24328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:24336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.246992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:24344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750c000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.246999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.247007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:24352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000750e000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.247013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.247020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:24360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007510000 len:0x1000 key:0x187200 00:31:29.895 [2024-04-26 01:05:31.247026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.247033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:24656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.247039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.247046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.895 [2024-04-26 01:05:31.247052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.895 [2024-04-26 01:05:31.247059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:24672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.896 [2024-04-26 01:05:31.247065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:24680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:31:29.896 [2024-04-26 01:05:31.247078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:24376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:24400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.247152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:24408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.247158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:24416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:24424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:24432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000751e000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:24440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007520000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:24448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007522000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.255645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:24464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x187200 00:31:29.896 [2024-04-26 01:05:31.255651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.257439] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:31:29.896 [2024-04-26 01:05:31.257448] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:31:29.896 [2024-04-26 01:05:31.257455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24472 len:8 PRP1 0x0 PRP2 0x0 00:31:29.896 [2024-04-26 01:05:31.257461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.257496] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:31:29.896 [2024-04-26 01:05:31.257504] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:31:29.896 [2024-04-26 01:05:31.257511] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:29.896 [2024-04-26 01:05:31.257537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:31:29.896 [2024-04-26 01:05:31.257545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.257555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:31:29.896 [2024-04-26 01:05:31.257560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.257567] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:31:29.896 [2024-04-26 01:05:31.257572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.257578] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:31:29.896 [2024-04-26 01:05:31.257584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:31:29.896 [2024-04-26 01:05:31.273860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:29.896 [2024-04-26 01:05:31.273880] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:31:29.896 [2024-04-26 01:05:31.273886] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:31:29.896 [2024-04-26 01:05:31.276424] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:29.896 [2024-04-26 01:05:31.307487] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:29.896 00:31:29.896 Latency(us) 00:31:29.896 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:29.896 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:29.896 Verification LBA range: start 0x0 length 0x4000 00:31:29.896 NVMe0n1 : 15.00 15571.51 60.83 275.45 0.00 8056.16 310.99 1043915.66 00:31:29.896 =================================================================================================================== 00:31:29.896 Total : 15571.51 60.83 275.45 0.00 8056.16 310.99 1043915.66 00:31:29.896 Received shutdown signal, test time was about 15.000000 seconds 00:31:29.896 00:31:29.896 Latency(us) 00:31:29.896 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:29.896 =================================================================================================================== 00:31:29.896 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:31:29.896 01:05:36 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:31:29.896 01:05:36 -- host/failover.sh@65 -- # count=3 00:31:29.896 01:05:36 -- host/failover.sh@67 -- # (( count != 3 )) 00:31:29.896 01:05:36 -- host/failover.sh@73 -- # bdevperf_pid=502378 00:31:29.896 01:05:36 -- host/failover.sh@75 -- # waitforlisten 502378 /var/tmp/bdevperf.sock 00:31:29.896 01:05:36 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:31:29.896 01:05:36 -- common/autotest_common.sh@817 -- # '[' -z 502378 ']' 00:31:29.896 01:05:36 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:31:29.896 01:05:36 -- common/autotest_common.sh@822 -- # local max_retries=100 00:31:29.896 01:05:36 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:31:29.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:31:29.896 01:05:36 -- common/autotest_common.sh@826 -- # xtrace_disable 00:31:29.896 01:05:36 -- common/autotest_common.sh@10 -- # set +x 00:31:30.465 01:05:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:31:30.465 01:05:37 -- common/autotest_common.sh@850 -- # return 0 00:31:30.465 01:05:37 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:31:30.724 [2024-04-26 01:05:37.714141] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:31:30.724 01:05:37 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:31:30.724 [2024-04-26 01:05:37.870683] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:31:30.724 01:05:37 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:30.983 NVMe0n1 00:31:30.983 01:05:38 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:31.243 00:31:31.243 01:05:38 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:31.502 00:31:31.502 01:05:38 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:31.502 01:05:38 -- host/failover.sh@82 -- # grep -q NVMe0 00:31:31.762 01:05:38 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:31.762 01:05:38 -- host/failover.sh@87 -- # sleep 3 00:31:35.056 01:05:41 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:35.056 01:05:41 -- host/failover.sh@88 -- # grep -q NVMe0 00:31:35.056 01:05:42 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:31:35.056 01:05:42 -- host/failover.sh@90 -- # run_test_pid=503369 00:31:35.056 01:05:42 -- host/failover.sh@92 -- # wait 503369 00:31:35.994 0 00:31:35.994 01:05:43 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:35.994 [2024-04-26 01:05:36.806424] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:31:35.994 [2024-04-26 01:05:36.806474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid502378 ] 00:31:35.994 EAL: No free 2048 kB hugepages reported on node 1 00:31:35.994 [2024-04-26 01:05:36.857091] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:35.994 [2024-04-26 01:05:36.917855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:35.994 [2024-04-26 01:05:38.875567] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:31:35.994 [2024-04-26 01:05:38.876124] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:31:35.994 [2024-04-26 01:05:38.876153] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:31:35.994 [2024-04-26 01:05:38.895160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:31:35.994 [2024-04-26 01:05:38.911188] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:31:35.994 Running I/O for 1 seconds... 00:31:35.994 00:31:35.994 Latency(us) 00:31:35.994 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:31:35.994 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:31:35.994 Verification LBA range: start 0x0 length 0x4000 00:31:35.994 NVMe0n1 : 1.01 19477.50 76.08 0.00 0.00 6537.32 2500.08 15922.82 00:31:35.994 =================================================================================================================== 00:31:35.994 Total : 19477.50 76.08 0.00 0.00 6537.32 2500.08 15922.82 00:31:35.994 01:05:43 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:35.994 01:05:43 -- host/failover.sh@95 -- # grep -q NVMe0 00:31:36.254 01:05:43 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:36.513 01:05:43 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:36.513 01:05:43 -- host/failover.sh@99 -- # grep -q NVMe0 00:31:36.513 01:05:43 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:31:36.771 01:05:43 -- host/failover.sh@101 -- # sleep 3 00:31:40.064 01:05:46 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:31:40.064 01:05:46 -- host/failover.sh@103 -- # grep -q NVMe0 00:31:40.064 01:05:47 -- host/failover.sh@108 -- # killprocess 502378 00:31:40.064 01:05:47 -- common/autotest_common.sh@936 -- # '[' -z 502378 ']' 00:31:40.064 01:05:47 -- common/autotest_common.sh@940 -- # kill -0 502378 00:31:40.064 01:05:47 -- common/autotest_common.sh@941 -- # uname 00:31:40.064 01:05:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:40.064 01:05:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 502378 00:31:40.064 01:05:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:40.064 01:05:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:40.064 01:05:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 502378' 00:31:40.064 killing process with pid 502378 00:31:40.064 01:05:47 -- common/autotest_common.sh@955 -- # kill 502378 00:31:40.064 01:05:47 -- common/autotest_common.sh@960 -- # wait 502378 00:31:40.064 01:05:47 -- host/failover.sh@110 -- # sync 00:31:40.324 01:05:47 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:40.324 01:05:47 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:31:40.324 01:05:47 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:31:40.324 01:05:47 -- host/failover.sh@116 -- # nvmftestfini 00:31:40.324 01:05:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:40.324 01:05:47 -- nvmf/common.sh@117 -- # sync 00:31:40.324 01:05:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:40.324 01:05:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:40.324 01:05:47 -- nvmf/common.sh@120 -- # set +e 00:31:40.324 01:05:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:40.324 01:05:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:40.324 rmmod nvme_rdma 00:31:40.324 rmmod nvme_fabrics 00:31:40.324 01:05:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:40.324 01:05:47 -- nvmf/common.sh@124 -- # set -e 00:31:40.324 01:05:47 -- nvmf/common.sh@125 -- # return 0 00:31:40.324 01:05:47 -- nvmf/common.sh@478 -- # '[' -n 499127 ']' 00:31:40.324 01:05:47 -- nvmf/common.sh@479 -- # killprocess 499127 00:31:40.324 01:05:47 -- common/autotest_common.sh@936 -- # '[' -z 499127 ']' 00:31:40.324 01:05:47 -- common/autotest_common.sh@940 -- # kill -0 499127 00:31:40.324 01:05:47 -- common/autotest_common.sh@941 -- # uname 00:31:40.324 01:05:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:40.324 01:05:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 499127 00:31:40.586 01:05:47 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:31:40.586 01:05:47 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:31:40.586 01:05:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 499127' 00:31:40.586 killing process with pid 499127 00:31:40.586 01:05:47 -- common/autotest_common.sh@955 -- # kill 499127 00:31:40.586 01:05:47 -- common/autotest_common.sh@960 -- # wait 499127 00:31:40.586 [2024-04-26 01:05:47.584642] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:31:40.846 01:05:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:40.846 01:05:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:40.846 00:31:40.846 real 0m34.861s 00:31:40.846 user 2m0.910s 00:31:40.846 sys 0m5.473s 00:31:40.846 01:05:47 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:40.846 01:05:47 -- common/autotest_common.sh@10 -- # set +x 00:31:40.846 ************************************ 00:31:40.846 END TEST nvmf_failover 00:31:40.846 ************************************ 00:31:40.846 01:05:47 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:40.846 01:05:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:40.846 01:05:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:40.846 01:05:47 -- common/autotest_common.sh@10 -- # set +x 00:31:40.847 ************************************ 00:31:40.847 START TEST nvmf_discovery 00:31:40.847 ************************************ 00:31:40.847 01:05:47 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:31:41.107 * Looking for test storage... 00:31:41.107 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:41.107 01:05:48 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:41.107 01:05:48 -- nvmf/common.sh@7 -- # uname -s 00:31:41.107 01:05:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:41.107 01:05:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:41.107 01:05:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:41.107 01:05:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:41.107 01:05:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:41.107 01:05:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:41.107 01:05:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:41.107 01:05:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:41.107 01:05:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:41.107 01:05:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:41.107 01:05:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.107 01:05:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.107 01:05:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:41.107 01:05:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:41.107 01:05:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:41.107 01:05:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:41.107 01:05:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:41.107 01:05:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:41.107 01:05:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:41.107 01:05:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:41.107 01:05:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.107 01:05:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.107 01:05:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.107 01:05:48 -- paths/export.sh@5 -- # export PATH 00:31:41.107 01:05:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.107 01:05:48 -- nvmf/common.sh@47 -- # : 0 00:31:41.107 01:05:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:41.107 01:05:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:41.107 01:05:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:41.107 01:05:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:41.107 01:05:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:41.107 01:05:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:41.107 01:05:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:41.107 01:05:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:41.107 01:05:48 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:31:41.107 01:05:48 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:41.107 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:41.107 01:05:48 -- host/discovery.sh@13 -- # exit 0 00:31:41.107 00:31:41.107 real 0m0.104s 00:31:41.107 user 0m0.050s 00:31:41.107 sys 0m0.062s 00:31:41.107 01:05:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:41.107 01:05:48 -- common/autotest_common.sh@10 -- # set +x 00:31:41.107 ************************************ 00:31:41.107 END TEST nvmf_discovery 00:31:41.107 ************************************ 00:31:41.107 01:05:48 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:41.107 01:05:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:41.107 01:05:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:41.107 01:05:48 -- common/autotest_common.sh@10 -- # set +x 00:31:41.107 ************************************ 00:31:41.107 START TEST nvmf_discovery_remove_ifc 00:31:41.107 ************************************ 00:31:41.107 01:05:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:31:41.368 * Looking for test storage... 00:31:41.368 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:41.368 01:05:48 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:41.368 01:05:48 -- nvmf/common.sh@7 -- # uname -s 00:31:41.369 01:05:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:41.369 01:05:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:41.369 01:05:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:41.369 01:05:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:41.369 01:05:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:41.369 01:05:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:41.369 01:05:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:41.369 01:05:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:41.369 01:05:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:41.369 01:05:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:41.369 01:05:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.369 01:05:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.369 01:05:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:41.369 01:05:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:41.369 01:05:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:41.369 01:05:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:41.369 01:05:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:41.369 01:05:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:41.369 01:05:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:41.369 01:05:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:41.369 01:05:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.369 01:05:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.369 01:05:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.369 01:05:48 -- paths/export.sh@5 -- # export PATH 00:31:41.369 01:05:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.369 01:05:48 -- nvmf/common.sh@47 -- # : 0 00:31:41.369 01:05:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:41.369 01:05:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:41.369 01:05:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:41.369 01:05:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:41.369 01:05:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:41.369 01:05:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:41.369 01:05:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:41.369 01:05:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:41.369 01:05:48 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:31:41.369 01:05:48 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:31:41.369 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:31:41.369 01:05:48 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:31:41.369 00:31:41.369 real 0m0.106s 00:31:41.369 user 0m0.062s 00:31:41.369 sys 0m0.052s 00:31:41.369 01:05:48 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:41.369 01:05:48 -- common/autotest_common.sh@10 -- # set +x 00:31:41.369 ************************************ 00:31:41.369 END TEST nvmf_discovery_remove_ifc 00:31:41.369 ************************************ 00:31:41.369 01:05:48 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:41.369 01:05:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:41.369 01:05:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:41.369 01:05:48 -- common/autotest_common.sh@10 -- # set +x 00:31:41.369 ************************************ 00:31:41.369 START TEST nvmf_identify_kernel_target 00:31:41.369 ************************************ 00:31:41.369 01:05:48 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:31:41.629 * Looking for test storage... 00:31:41.629 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:41.629 01:05:48 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:41.629 01:05:48 -- nvmf/common.sh@7 -- # uname -s 00:31:41.630 01:05:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:41.630 01:05:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:41.630 01:05:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:41.630 01:05:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:41.630 01:05:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:41.630 01:05:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:41.630 01:05:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:41.630 01:05:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:41.630 01:05:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:41.630 01:05:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:41.630 01:05:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.630 01:05:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:41.630 01:05:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:41.630 01:05:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:41.630 01:05:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:41.630 01:05:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:41.630 01:05:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:41.630 01:05:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:41.630 01:05:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:41.630 01:05:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:41.630 01:05:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.630 01:05:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.630 01:05:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.630 01:05:48 -- paths/export.sh@5 -- # export PATH 00:31:41.630 01:05:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:41.630 01:05:48 -- nvmf/common.sh@47 -- # : 0 00:31:41.630 01:05:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:41.630 01:05:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:41.630 01:05:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:41.630 01:05:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:41.630 01:05:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:41.630 01:05:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:41.630 01:05:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:41.630 01:05:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:41.630 01:05:48 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:31:41.630 01:05:48 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:41.630 01:05:48 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:41.630 01:05:48 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:41.630 01:05:48 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:41.630 01:05:48 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:41.630 01:05:48 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:41.630 01:05:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:41.630 01:05:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:41.630 01:05:48 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:41.630 01:05:48 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:41.630 01:05:48 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:41.630 01:05:48 -- common/autotest_common.sh@10 -- # set +x 00:31:46.908 01:05:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:46.908 01:05:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:31:46.908 01:05:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:31:46.908 01:05:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:31:46.908 01:05:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:31:46.908 01:05:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:31:46.908 01:05:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:31:46.908 01:05:53 -- nvmf/common.sh@295 -- # net_devs=() 00:31:46.908 01:05:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:31:46.908 01:05:53 -- nvmf/common.sh@296 -- # e810=() 00:31:46.908 01:05:53 -- nvmf/common.sh@296 -- # local -ga e810 00:31:46.908 01:05:53 -- nvmf/common.sh@297 -- # x722=() 00:31:46.908 01:05:53 -- nvmf/common.sh@297 -- # local -ga x722 00:31:46.908 01:05:53 -- nvmf/common.sh@298 -- # mlx=() 00:31:46.908 01:05:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:31:46.908 01:05:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:46.908 01:05:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:31:46.908 01:05:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:31:46.908 01:05:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:31:46.908 01:05:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:31:46.908 01:05:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:31:46.908 01:05:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:46.908 01:05:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:31:46.908 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:31:46.908 01:05:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:46.908 01:05:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:31:46.908 01:05:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:31:46.908 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:31:46.908 01:05:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:31:46.908 01:05:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:31:46.908 01:05:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:31:46.908 01:05:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:46.909 01:05:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:46.909 01:05:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:46.909 01:05:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:31:46.909 Found net devices under 0000:18:00.0: mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:46.909 01:05:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:46.909 01:05:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:31:46.909 01:05:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:46.909 01:05:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:31:46.909 Found net devices under 0000:18:00.1: mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:31:46.909 01:05:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:31:46.909 01:05:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:31:46.909 01:05:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:31:46.909 01:05:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:31:46.909 01:05:53 -- nvmf/common.sh@58 -- # uname 00:31:46.909 01:05:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:31:46.909 01:05:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:31:46.909 01:05:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:31:46.909 01:05:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:31:46.909 01:05:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:31:46.909 01:05:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:31:46.909 01:05:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:31:46.909 01:05:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:31:46.909 01:05:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:31:46.909 01:05:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:31:46.909 01:05:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:31:46.909 01:05:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:46.909 01:05:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:46.909 01:05:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:46.909 01:05:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:46.909 01:05:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:46.909 01:05:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@105 -- # continue 2 00:31:46.909 01:05:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@105 -- # continue 2 00:31:46.909 01:05:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:46.909 01:05:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:46.909 01:05:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:31:46.909 01:05:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:31:46.909 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:46.909 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:31:46.909 altname enp24s0f0np0 00:31:46.909 altname ens785f0np0 00:31:46.909 inet 192.168.100.8/24 scope global mlx_0_0 00:31:46.909 valid_lft forever preferred_lft forever 00:31:46.909 01:05:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:31:46.909 01:05:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:46.909 01:05:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:31:46.909 01:05:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:31:46.909 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:31:46.909 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:31:46.909 altname enp24s0f1np1 00:31:46.909 altname ens785f1np1 00:31:46.909 inet 192.168.100.9/24 scope global mlx_0_1 00:31:46.909 valid_lft forever preferred_lft forever 00:31:46.909 01:05:53 -- nvmf/common.sh@411 -- # return 0 00:31:46.909 01:05:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:31:46.909 01:05:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:31:46.909 01:05:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:31:46.909 01:05:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:31:46.909 01:05:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:31:46.909 01:05:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:31:46.909 01:05:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:31:46.909 01:05:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:31:46.909 01:05:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:31:46.909 01:05:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@105 -- # continue 2 00:31:46.909 01:05:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:31:46.909 01:05:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@105 -- # continue 2 00:31:46.909 01:05:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:46.909 01:05:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:46.909 01:05:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:31:46.909 01:05:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:31:46.909 01:05:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:31:46.909 01:05:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:31:46.909 192.168.100.9' 00:31:46.909 01:05:53 -- nvmf/common.sh@446 -- # head -n 1 00:31:46.909 01:05:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:31:46.909 192.168.100.9' 00:31:46.909 01:05:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:31:46.909 01:05:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:31:46.909 192.168.100.9' 00:31:46.909 01:05:53 -- nvmf/common.sh@447 -- # tail -n +2 00:31:46.909 01:05:53 -- nvmf/common.sh@447 -- # head -n 1 00:31:46.909 01:05:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:31:46.909 01:05:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:31:46.909 01:05:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:31:46.909 01:05:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:31:46.909 01:05:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:31:46.909 01:05:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:31:46.909 01:05:53 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:31:46.909 01:05:53 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:31:46.909 01:05:53 -- nvmf/common.sh@717 -- # local ip 00:31:46.909 01:05:53 -- nvmf/common.sh@718 -- # ip_candidates=() 00:31:46.909 01:05:53 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:31:46.909 01:05:53 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:31:46.909 01:05:53 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:31:46.909 01:05:53 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:31:46.909 01:05:53 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:31:46.909 01:05:53 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:31:46.909 01:05:53 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:31:46.909 01:05:53 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:31:46.909 01:05:53 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:31:46.909 01:05:53 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:46.909 01:05:53 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:46.909 01:05:53 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:31:46.909 01:05:53 -- nvmf/common.sh@628 -- # local block nvme 00:31:46.909 01:05:53 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@631 -- # modprobe nvmet 00:31:46.909 01:05:53 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:31:46.909 01:05:53 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:31:48.815 Waiting for block devices as requested 00:31:48.815 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:48.815 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:49.074 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:49.074 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:49.074 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:49.074 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:49.334 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:49.334 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:49.334 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:49.334 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:49.593 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:49.593 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:49.593 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:49.593 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:49.853 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:49.853 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:49.853 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:31:51.234 01:05:58 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:31:51.234 01:05:58 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:31:51.234 01:05:58 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:31:51.234 01:05:58 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:31:51.234 01:05:58 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:31:51.234 01:05:58 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:31:51.234 01:05:58 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:31:51.234 01:05:58 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:31:51.234 01:05:58 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:31:51.234 No valid GPT data, bailing 00:31:51.234 01:05:58 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:31:51.234 01:05:58 -- scripts/common.sh@391 -- # pt= 00:31:51.234 01:05:58 -- scripts/common.sh@392 -- # return 1 00:31:51.234 01:05:58 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:31:51.234 01:05:58 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:31:51.234 01:05:58 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:51.234 01:05:58 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:51.234 01:05:58 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:31:51.234 01:05:58 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:31:51.234 01:05:58 -- nvmf/common.sh@656 -- # echo 1 00:31:51.234 01:05:58 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:31:51.234 01:05:58 -- nvmf/common.sh@658 -- # echo 1 00:31:51.234 01:05:58 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:31:51.234 01:05:58 -- nvmf/common.sh@661 -- # echo rdma 00:31:51.234 01:05:58 -- nvmf/common.sh@662 -- # echo 4420 00:31:51.234 01:05:58 -- nvmf/common.sh@663 -- # echo ipv4 00:31:51.234 01:05:58 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:31:51.234 01:05:58 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:31:51.495 00:31:51.495 Discovery Log Number of Records 2, Generation counter 2 00:31:51.495 =====Discovery Log Entry 0====== 00:31:51.495 trtype: rdma 00:31:51.495 adrfam: ipv4 00:31:51.495 subtype: current discovery subsystem 00:31:51.495 treq: not specified, sq flow control disable supported 00:31:51.495 portid: 1 00:31:51.495 trsvcid: 4420 00:31:51.495 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:31:51.495 traddr: 192.168.100.8 00:31:51.495 eflags: none 00:31:51.495 rdma_prtype: not specified 00:31:51.495 rdma_qptype: connected 00:31:51.495 rdma_cms: rdma-cm 00:31:51.495 rdma_pkey: 0x0000 00:31:51.495 =====Discovery Log Entry 1====== 00:31:51.495 trtype: rdma 00:31:51.495 adrfam: ipv4 00:31:51.495 subtype: nvme subsystem 00:31:51.495 treq: not specified, sq flow control disable supported 00:31:51.495 portid: 1 00:31:51.495 trsvcid: 4420 00:31:51.495 subnqn: nqn.2016-06.io.spdk:testnqn 00:31:51.495 traddr: 192.168.100.8 00:31:51.495 eflags: none 00:31:51.495 rdma_prtype: not specified 00:31:51.495 rdma_qptype: connected 00:31:51.495 rdma_cms: rdma-cm 00:31:51.495 rdma_pkey: 0x0000 00:31:51.495 01:05:58 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:31:51.495 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:31:51.495 EAL: No free 2048 kB hugepages reported on node 1 00:31:51.495 ===================================================== 00:31:51.495 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:31:51.495 ===================================================== 00:31:51.495 Controller Capabilities/Features 00:31:51.495 ================================ 00:31:51.495 Vendor ID: 0000 00:31:51.495 Subsystem Vendor ID: 0000 00:31:51.495 Serial Number: 0099c35aa8fb7a02e125 00:31:51.495 Model Number: Linux 00:31:51.495 Firmware Version: 6.7.0-68 00:31:51.495 Recommended Arb Burst: 0 00:31:51.495 IEEE OUI Identifier: 00 00 00 00:31:51.495 Multi-path I/O 00:31:51.495 May have multiple subsystem ports: No 00:31:51.495 May have multiple controllers: No 00:31:51.495 Associated with SR-IOV VF: No 00:31:51.495 Max Data Transfer Size: Unlimited 00:31:51.495 Max Number of Namespaces: 0 00:31:51.495 Max Number of I/O Queues: 1024 00:31:51.495 NVMe Specification Version (VS): 1.3 00:31:51.495 NVMe Specification Version (Identify): 1.3 00:31:51.495 Maximum Queue Entries: 128 00:31:51.495 Contiguous Queues Required: No 00:31:51.495 Arbitration Mechanisms Supported 00:31:51.495 Weighted Round Robin: Not Supported 00:31:51.495 Vendor Specific: Not Supported 00:31:51.495 Reset Timeout: 7500 ms 00:31:51.495 Doorbell Stride: 4 bytes 00:31:51.495 NVM Subsystem Reset: Not Supported 00:31:51.495 Command Sets Supported 00:31:51.495 NVM Command Set: Supported 00:31:51.495 Boot Partition: Not Supported 00:31:51.495 Memory Page Size Minimum: 4096 bytes 00:31:51.495 Memory Page Size Maximum: 4096 bytes 00:31:51.495 Persistent Memory Region: Not Supported 00:31:51.495 Optional Asynchronous Events Supported 00:31:51.495 Namespace Attribute Notices: Not Supported 00:31:51.495 Firmware Activation Notices: Not Supported 00:31:51.495 ANA Change Notices: Not Supported 00:31:51.495 PLE Aggregate Log Change Notices: Not Supported 00:31:51.495 LBA Status Info Alert Notices: Not Supported 00:31:51.495 EGE Aggregate Log Change Notices: Not Supported 00:31:51.495 Normal NVM Subsystem Shutdown event: Not Supported 00:31:51.495 Zone Descriptor Change Notices: Not Supported 00:31:51.495 Discovery Log Change Notices: Supported 00:31:51.495 Controller Attributes 00:31:51.495 128-bit Host Identifier: Not Supported 00:31:51.495 Non-Operational Permissive Mode: Not Supported 00:31:51.495 NVM Sets: Not Supported 00:31:51.495 Read Recovery Levels: Not Supported 00:31:51.495 Endurance Groups: Not Supported 00:31:51.495 Predictable Latency Mode: Not Supported 00:31:51.495 Traffic Based Keep ALive: Not Supported 00:31:51.495 Namespace Granularity: Not Supported 00:31:51.495 SQ Associations: Not Supported 00:31:51.495 UUID List: Not Supported 00:31:51.495 Multi-Domain Subsystem: Not Supported 00:31:51.495 Fixed Capacity Management: Not Supported 00:31:51.495 Variable Capacity Management: Not Supported 00:31:51.495 Delete Endurance Group: Not Supported 00:31:51.495 Delete NVM Set: Not Supported 00:31:51.495 Extended LBA Formats Supported: Not Supported 00:31:51.495 Flexible Data Placement Supported: Not Supported 00:31:51.495 00:31:51.495 Controller Memory Buffer Support 00:31:51.495 ================================ 00:31:51.495 Supported: No 00:31:51.495 00:31:51.495 Persistent Memory Region Support 00:31:51.495 ================================ 00:31:51.495 Supported: No 00:31:51.495 00:31:51.495 Admin Command Set Attributes 00:31:51.495 ============================ 00:31:51.495 Security Send/Receive: Not Supported 00:31:51.495 Format NVM: Not Supported 00:31:51.495 Firmware Activate/Download: Not Supported 00:31:51.495 Namespace Management: Not Supported 00:31:51.495 Device Self-Test: Not Supported 00:31:51.496 Directives: Not Supported 00:31:51.496 NVMe-MI: Not Supported 00:31:51.496 Virtualization Management: Not Supported 00:31:51.496 Doorbell Buffer Config: Not Supported 00:31:51.496 Get LBA Status Capability: Not Supported 00:31:51.496 Command & Feature Lockdown Capability: Not Supported 00:31:51.496 Abort Command Limit: 1 00:31:51.496 Async Event Request Limit: 1 00:31:51.496 Number of Firmware Slots: N/A 00:31:51.496 Firmware Slot 1 Read-Only: N/A 00:31:51.496 Firmware Activation Without Reset: N/A 00:31:51.496 Multiple Update Detection Support: N/A 00:31:51.496 Firmware Update Granularity: No Information Provided 00:31:51.496 Per-Namespace SMART Log: No 00:31:51.496 Asymmetric Namespace Access Log Page: Not Supported 00:31:51.496 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:31:51.496 Command Effects Log Page: Not Supported 00:31:51.496 Get Log Page Extended Data: Supported 00:31:51.496 Telemetry Log Pages: Not Supported 00:31:51.496 Persistent Event Log Pages: Not Supported 00:31:51.496 Supported Log Pages Log Page: May Support 00:31:51.496 Commands Supported & Effects Log Page: Not Supported 00:31:51.496 Feature Identifiers & Effects Log Page:May Support 00:31:51.496 NVMe-MI Commands & Effects Log Page: May Support 00:31:51.496 Data Area 4 for Telemetry Log: Not Supported 00:31:51.496 Error Log Page Entries Supported: 1 00:31:51.496 Keep Alive: Not Supported 00:31:51.496 00:31:51.496 NVM Command Set Attributes 00:31:51.496 ========================== 00:31:51.496 Submission Queue Entry Size 00:31:51.496 Max: 1 00:31:51.496 Min: 1 00:31:51.496 Completion Queue Entry Size 00:31:51.496 Max: 1 00:31:51.496 Min: 1 00:31:51.496 Number of Namespaces: 0 00:31:51.496 Compare Command: Not Supported 00:31:51.496 Write Uncorrectable Command: Not Supported 00:31:51.496 Dataset Management Command: Not Supported 00:31:51.496 Write Zeroes Command: Not Supported 00:31:51.496 Set Features Save Field: Not Supported 00:31:51.496 Reservations: Not Supported 00:31:51.496 Timestamp: Not Supported 00:31:51.496 Copy: Not Supported 00:31:51.496 Volatile Write Cache: Not Present 00:31:51.496 Atomic Write Unit (Normal): 1 00:31:51.496 Atomic Write Unit (PFail): 1 00:31:51.496 Atomic Compare & Write Unit: 1 00:31:51.496 Fused Compare & Write: Not Supported 00:31:51.496 Scatter-Gather List 00:31:51.496 SGL Command Set: Supported 00:31:51.496 SGL Keyed: Supported 00:31:51.496 SGL Bit Bucket Descriptor: Not Supported 00:31:51.496 SGL Metadata Pointer: Not Supported 00:31:51.496 Oversized SGL: Not Supported 00:31:51.496 SGL Metadata Address: Not Supported 00:31:51.496 SGL Offset: Supported 00:31:51.496 Transport SGL Data Block: Not Supported 00:31:51.496 Replay Protected Memory Block: Not Supported 00:31:51.496 00:31:51.496 Firmware Slot Information 00:31:51.496 ========================= 00:31:51.496 Active slot: 0 00:31:51.496 00:31:51.496 00:31:51.496 Error Log 00:31:51.496 ========= 00:31:51.496 00:31:51.496 Active Namespaces 00:31:51.496 ================= 00:31:51.496 Discovery Log Page 00:31:51.496 ================== 00:31:51.496 Generation Counter: 2 00:31:51.496 Number of Records: 2 00:31:51.496 Record Format: 0 00:31:51.496 00:31:51.496 Discovery Log Entry 0 00:31:51.496 ---------------------- 00:31:51.496 Transport Type: 1 (RDMA) 00:31:51.496 Address Family: 1 (IPv4) 00:31:51.496 Subsystem Type: 3 (Current Discovery Subsystem) 00:31:51.496 Entry Flags: 00:31:51.496 Duplicate Returned Information: 0 00:31:51.496 Explicit Persistent Connection Support for Discovery: 0 00:31:51.496 Transport Requirements: 00:31:51.496 Secure Channel: Not Specified 00:31:51.496 Port ID: 1 (0x0001) 00:31:51.496 Controller ID: 65535 (0xffff) 00:31:51.496 Admin Max SQ Size: 32 00:31:51.496 Transport Service Identifier: 4420 00:31:51.496 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:31:51.496 Transport Address: 192.168.100.8 00:31:51.496 Transport Specific Address Subtype - RDMA 00:31:51.496 RDMA QP Service Type: 1 (Reliable Connected) 00:31:51.496 RDMA Provider Type: 1 (No provider specified) 00:31:51.496 RDMA CM Service: 1 (RDMA_CM) 00:31:51.496 Discovery Log Entry 1 00:31:51.496 ---------------------- 00:31:51.496 Transport Type: 1 (RDMA) 00:31:51.496 Address Family: 1 (IPv4) 00:31:51.496 Subsystem Type: 2 (NVM Subsystem) 00:31:51.496 Entry Flags: 00:31:51.496 Duplicate Returned Information: 0 00:31:51.496 Explicit Persistent Connection Support for Discovery: 0 00:31:51.496 Transport Requirements: 00:31:51.496 Secure Channel: Not Specified 00:31:51.496 Port ID: 1 (0x0001) 00:31:51.496 Controller ID: 65535 (0xffff) 00:31:51.496 Admin Max SQ Size: 32 00:31:51.496 Transport Service Identifier: 4420 00:31:51.496 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:31:51.496 Transport Address: 192.168.100.8 00:31:51.496 Transport Specific Address Subtype - RDMA 00:31:51.496 RDMA QP Service Type: 1 (Reliable Connected) 00:31:51.496 RDMA Provider Type: 1 (No provider specified) 00:31:51.496 RDMA CM Service: 1 (RDMA_CM) 00:31:51.496 01:05:58 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:31:51.496 EAL: No free 2048 kB hugepages reported on node 1 00:31:51.757 get_feature(0x01) failed 00:31:51.757 get_feature(0x02) failed 00:31:51.757 get_feature(0x04) failed 00:31:51.757 ===================================================== 00:31:51.757 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:31:51.757 ===================================================== 00:31:51.757 Controller Capabilities/Features 00:31:51.757 ================================ 00:31:51.757 Vendor ID: 0000 00:31:51.757 Subsystem Vendor ID: 0000 00:31:51.757 Serial Number: 9a7f68edf91f44b33c64 00:31:51.757 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:31:51.757 Firmware Version: 6.7.0-68 00:31:51.757 Recommended Arb Burst: 6 00:31:51.757 IEEE OUI Identifier: 00 00 00 00:31:51.757 Multi-path I/O 00:31:51.757 May have multiple subsystem ports: Yes 00:31:51.757 May have multiple controllers: Yes 00:31:51.757 Associated with SR-IOV VF: No 00:31:51.757 Max Data Transfer Size: 1048576 00:31:51.757 Max Number of Namespaces: 1024 00:31:51.757 Max Number of I/O Queues: 128 00:31:51.757 NVMe Specification Version (VS): 1.3 00:31:51.757 NVMe Specification Version (Identify): 1.3 00:31:51.757 Maximum Queue Entries: 128 00:31:51.757 Contiguous Queues Required: No 00:31:51.757 Arbitration Mechanisms Supported 00:31:51.757 Weighted Round Robin: Not Supported 00:31:51.757 Vendor Specific: Not Supported 00:31:51.757 Reset Timeout: 7500 ms 00:31:51.757 Doorbell Stride: 4 bytes 00:31:51.757 NVM Subsystem Reset: Not Supported 00:31:51.757 Command Sets Supported 00:31:51.757 NVM Command Set: Supported 00:31:51.757 Boot Partition: Not Supported 00:31:51.757 Memory Page Size Minimum: 4096 bytes 00:31:51.757 Memory Page Size Maximum: 4096 bytes 00:31:51.757 Persistent Memory Region: Not Supported 00:31:51.757 Optional Asynchronous Events Supported 00:31:51.757 Namespace Attribute Notices: Supported 00:31:51.757 Firmware Activation Notices: Not Supported 00:31:51.757 ANA Change Notices: Supported 00:31:51.757 PLE Aggregate Log Change Notices: Not Supported 00:31:51.757 LBA Status Info Alert Notices: Not Supported 00:31:51.757 EGE Aggregate Log Change Notices: Not Supported 00:31:51.757 Normal NVM Subsystem Shutdown event: Not Supported 00:31:51.757 Zone Descriptor Change Notices: Not Supported 00:31:51.757 Discovery Log Change Notices: Not Supported 00:31:51.757 Controller Attributes 00:31:51.757 128-bit Host Identifier: Supported 00:31:51.757 Non-Operational Permissive Mode: Not Supported 00:31:51.757 NVM Sets: Not Supported 00:31:51.757 Read Recovery Levels: Not Supported 00:31:51.757 Endurance Groups: Not Supported 00:31:51.757 Predictable Latency Mode: Not Supported 00:31:51.757 Traffic Based Keep ALive: Supported 00:31:51.757 Namespace Granularity: Not Supported 00:31:51.757 SQ Associations: Not Supported 00:31:51.757 UUID List: Not Supported 00:31:51.757 Multi-Domain Subsystem: Not Supported 00:31:51.757 Fixed Capacity Management: Not Supported 00:31:51.757 Variable Capacity Management: Not Supported 00:31:51.757 Delete Endurance Group: Not Supported 00:31:51.757 Delete NVM Set: Not Supported 00:31:51.757 Extended LBA Formats Supported: Not Supported 00:31:51.757 Flexible Data Placement Supported: Not Supported 00:31:51.757 00:31:51.757 Controller Memory Buffer Support 00:31:51.757 ================================ 00:31:51.757 Supported: No 00:31:51.757 00:31:51.757 Persistent Memory Region Support 00:31:51.757 ================================ 00:31:51.757 Supported: No 00:31:51.757 00:31:51.757 Admin Command Set Attributes 00:31:51.757 ============================ 00:31:51.757 Security Send/Receive: Not Supported 00:31:51.757 Format NVM: Not Supported 00:31:51.757 Firmware Activate/Download: Not Supported 00:31:51.757 Namespace Management: Not Supported 00:31:51.757 Device Self-Test: Not Supported 00:31:51.757 Directives: Not Supported 00:31:51.757 NVMe-MI: Not Supported 00:31:51.757 Virtualization Management: Not Supported 00:31:51.757 Doorbell Buffer Config: Not Supported 00:31:51.757 Get LBA Status Capability: Not Supported 00:31:51.757 Command & Feature Lockdown Capability: Not Supported 00:31:51.757 Abort Command Limit: 4 00:31:51.757 Async Event Request Limit: 4 00:31:51.757 Number of Firmware Slots: N/A 00:31:51.757 Firmware Slot 1 Read-Only: N/A 00:31:51.757 Firmware Activation Without Reset: N/A 00:31:51.757 Multiple Update Detection Support: N/A 00:31:51.757 Firmware Update Granularity: No Information Provided 00:31:51.757 Per-Namespace SMART Log: Yes 00:31:51.757 Asymmetric Namespace Access Log Page: Supported 00:31:51.757 ANA Transition Time : 10 sec 00:31:51.757 00:31:51.757 Asymmetric Namespace Access Capabilities 00:31:51.757 ANA Optimized State : Supported 00:31:51.757 ANA Non-Optimized State : Supported 00:31:51.757 ANA Inaccessible State : Supported 00:31:51.757 ANA Persistent Loss State : Supported 00:31:51.757 ANA Change State : Supported 00:31:51.757 ANAGRPID is not changed : No 00:31:51.757 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:31:51.757 00:31:51.757 ANA Group Identifier Maximum : 128 00:31:51.757 Number of ANA Group Identifiers : 128 00:31:51.757 Max Number of Allowed Namespaces : 1024 00:31:51.757 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:31:51.757 Command Effects Log Page: Supported 00:31:51.757 Get Log Page Extended Data: Supported 00:31:51.757 Telemetry Log Pages: Not Supported 00:31:51.757 Persistent Event Log Pages: Not Supported 00:31:51.757 Supported Log Pages Log Page: May Support 00:31:51.757 Commands Supported & Effects Log Page: Not Supported 00:31:51.757 Feature Identifiers & Effects Log Page:May Support 00:31:51.757 NVMe-MI Commands & Effects Log Page: May Support 00:31:51.757 Data Area 4 for Telemetry Log: Not Supported 00:31:51.757 Error Log Page Entries Supported: 128 00:31:51.757 Keep Alive: Supported 00:31:51.757 Keep Alive Granularity: 1000 ms 00:31:51.757 00:31:51.757 NVM Command Set Attributes 00:31:51.757 ========================== 00:31:51.757 Submission Queue Entry Size 00:31:51.757 Max: 64 00:31:51.757 Min: 64 00:31:51.757 Completion Queue Entry Size 00:31:51.757 Max: 16 00:31:51.757 Min: 16 00:31:51.757 Number of Namespaces: 1024 00:31:51.757 Compare Command: Not Supported 00:31:51.757 Write Uncorrectable Command: Not Supported 00:31:51.757 Dataset Management Command: Supported 00:31:51.757 Write Zeroes Command: Supported 00:31:51.757 Set Features Save Field: Not Supported 00:31:51.757 Reservations: Not Supported 00:31:51.757 Timestamp: Not Supported 00:31:51.757 Copy: Not Supported 00:31:51.757 Volatile Write Cache: Present 00:31:51.757 Atomic Write Unit (Normal): 1 00:31:51.757 Atomic Write Unit (PFail): 1 00:31:51.757 Atomic Compare & Write Unit: 1 00:31:51.757 Fused Compare & Write: Not Supported 00:31:51.757 Scatter-Gather List 00:31:51.757 SGL Command Set: Supported 00:31:51.757 SGL Keyed: Supported 00:31:51.757 SGL Bit Bucket Descriptor: Not Supported 00:31:51.757 SGL Metadata Pointer: Not Supported 00:31:51.757 Oversized SGL: Not Supported 00:31:51.757 SGL Metadata Address: Not Supported 00:31:51.757 SGL Offset: Supported 00:31:51.757 Transport SGL Data Block: Not Supported 00:31:51.757 Replay Protected Memory Block: Not Supported 00:31:51.757 00:31:51.757 Firmware Slot Information 00:31:51.757 ========================= 00:31:51.757 Active slot: 0 00:31:51.757 00:31:51.757 Asymmetric Namespace Access 00:31:51.758 =========================== 00:31:51.758 Change Count : 0 00:31:51.758 Number of ANA Group Descriptors : 1 00:31:51.758 ANA Group Descriptor : 0 00:31:51.758 ANA Group ID : 1 00:31:51.758 Number of NSID Values : 1 00:31:51.758 Change Count : 0 00:31:51.758 ANA State : 1 00:31:51.758 Namespace Identifier : 1 00:31:51.758 00:31:51.758 Commands Supported and Effects 00:31:51.758 ============================== 00:31:51.758 Admin Commands 00:31:51.758 -------------- 00:31:51.758 Get Log Page (02h): Supported 00:31:51.758 Identify (06h): Supported 00:31:51.758 Abort (08h): Supported 00:31:51.758 Set Features (09h): Supported 00:31:51.758 Get Features (0Ah): Supported 00:31:51.758 Asynchronous Event Request (0Ch): Supported 00:31:51.758 Keep Alive (18h): Supported 00:31:51.758 I/O Commands 00:31:51.758 ------------ 00:31:51.758 Flush (00h): Supported 00:31:51.758 Write (01h): Supported LBA-Change 00:31:51.758 Read (02h): Supported 00:31:51.758 Write Zeroes (08h): Supported LBA-Change 00:31:51.758 Dataset Management (09h): Supported 00:31:51.758 00:31:51.758 Error Log 00:31:51.758 ========= 00:31:51.758 Entry: 0 00:31:51.758 Error Count: 0x3 00:31:51.758 Submission Queue Id: 0x0 00:31:51.758 Command Id: 0x5 00:31:51.758 Phase Bit: 0 00:31:51.758 Status Code: 0x2 00:31:51.758 Status Code Type: 0x0 00:31:51.758 Do Not Retry: 1 00:31:51.758 Error Location: 0x28 00:31:51.758 LBA: 0x0 00:31:51.758 Namespace: 0x0 00:31:51.758 Vendor Log Page: 0x0 00:31:51.758 ----------- 00:31:51.758 Entry: 1 00:31:51.758 Error Count: 0x2 00:31:51.758 Submission Queue Id: 0x0 00:31:51.758 Command Id: 0x5 00:31:51.758 Phase Bit: 0 00:31:51.758 Status Code: 0x2 00:31:51.758 Status Code Type: 0x0 00:31:51.758 Do Not Retry: 1 00:31:51.758 Error Location: 0x28 00:31:51.758 LBA: 0x0 00:31:51.758 Namespace: 0x0 00:31:51.758 Vendor Log Page: 0x0 00:31:51.758 ----------- 00:31:51.758 Entry: 2 00:31:51.758 Error Count: 0x1 00:31:51.758 Submission Queue Id: 0x0 00:31:51.758 Command Id: 0x0 00:31:51.758 Phase Bit: 0 00:31:51.758 Status Code: 0x2 00:31:51.758 Status Code Type: 0x0 00:31:51.758 Do Not Retry: 1 00:31:51.758 Error Location: 0x28 00:31:51.758 LBA: 0x0 00:31:51.758 Namespace: 0x0 00:31:51.758 Vendor Log Page: 0x0 00:31:51.758 00:31:51.758 Number of Queues 00:31:51.758 ================ 00:31:51.758 Number of I/O Submission Queues: 128 00:31:51.758 Number of I/O Completion Queues: 128 00:31:51.758 00:31:51.758 ZNS Specific Controller Data 00:31:51.758 ============================ 00:31:51.758 Zone Append Size Limit: 0 00:31:51.758 00:31:51.758 00:31:51.758 Active Namespaces 00:31:51.758 ================= 00:31:51.758 get_feature(0x05) failed 00:31:51.758 Namespace ID:1 00:31:51.758 Command Set Identifier: NVM (00h) 00:31:51.758 Deallocate: Supported 00:31:51.758 Deallocated/Unwritten Error: Not Supported 00:31:51.758 Deallocated Read Value: Unknown 00:31:51.758 Deallocate in Write Zeroes: Not Supported 00:31:51.758 Deallocated Guard Field: 0xFFFF 00:31:51.758 Flush: Supported 00:31:51.758 Reservation: Not Supported 00:31:51.758 Namespace Sharing Capabilities: Multiple Controllers 00:31:51.758 Size (in LBAs): 7814037168 (3726GiB) 00:31:51.758 Capacity (in LBAs): 7814037168 (3726GiB) 00:31:51.758 Utilization (in LBAs): 7814037168 (3726GiB) 00:31:51.758 UUID: 32371d76-2a2b-4308-b6bf-dc2620e7e7dc 00:31:51.758 Thin Provisioning: Not Supported 00:31:51.758 Per-NS Atomic Units: Yes 00:31:51.758 Atomic Boundary Size (Normal): 0 00:31:51.758 Atomic Boundary Size (PFail): 0 00:31:51.758 Atomic Boundary Offset: 0 00:31:51.758 NGUID/EUI64 Never Reused: No 00:31:51.758 ANA group ID: 1 00:31:51.758 Namespace Write Protected: No 00:31:51.758 Number of LBA Formats: 1 00:31:51.758 Current LBA Format: LBA Format #00 00:31:51.758 LBA Format #00: Data Size: 512 Metadata Size: 0 00:31:51.758 00:31:51.758 01:05:58 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:31:51.758 01:05:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:31:51.758 01:05:58 -- nvmf/common.sh@117 -- # sync 00:31:51.758 01:05:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:31:51.758 01:05:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:31:51.758 01:05:58 -- nvmf/common.sh@120 -- # set +e 00:31:51.758 01:05:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:31:51.758 01:05:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:31:51.758 rmmod nvme_rdma 00:31:51.758 rmmod nvme_fabrics 00:31:51.758 01:05:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:31:51.758 01:05:58 -- nvmf/common.sh@124 -- # set -e 00:31:51.758 01:05:58 -- nvmf/common.sh@125 -- # return 0 00:31:51.758 01:05:58 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:31:51.758 01:05:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:31:51.758 01:05:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:31:51.758 01:05:58 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:31:51.758 01:05:58 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:31:51.758 01:05:58 -- nvmf/common.sh@675 -- # echo 0 00:31:51.758 01:05:58 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:51.758 01:05:58 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:31:51.758 01:05:58 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:31:51.758 01:05:58 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:31:51.758 01:05:58 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:31:51.758 01:05:58 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:31:51.758 01:05:58 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:31:54.299 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:31:54.299 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:31:57.586 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:31:58.963 00:31:58.963 real 0m17.341s 00:31:58.963 user 0m3.839s 00:31:58.963 sys 0m8.995s 00:31:58.963 01:06:05 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:31:58.963 01:06:05 -- common/autotest_common.sh@10 -- # set +x 00:31:58.963 ************************************ 00:31:58.963 END TEST nvmf_identify_kernel_target 00:31:58.963 ************************************ 00:31:58.963 01:06:05 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:58.963 01:06:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:58.963 01:06:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:58.963 01:06:05 -- common/autotest_common.sh@10 -- # set +x 00:31:58.963 ************************************ 00:31:58.963 START TEST nvmf_auth 00:31:58.963 ************************************ 00:31:58.963 01:06:06 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:31:58.963 * Looking for test storage... 00:31:58.963 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:31:58.963 01:06:06 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:31:58.963 01:06:06 -- nvmf/common.sh@7 -- # uname -s 00:31:58.963 01:06:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:58.963 01:06:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:58.963 01:06:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:58.963 01:06:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:58.963 01:06:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:58.963 01:06:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:58.963 01:06:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:58.963 01:06:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:58.963 01:06:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:58.963 01:06:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:58.963 01:06:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:31:58.963 01:06:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:31:58.963 01:06:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:58.963 01:06:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:58.963 01:06:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:58.963 01:06:06 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:31:58.963 01:06:06 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:31:58.963 01:06:06 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:58.963 01:06:06 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:58.963 01:06:06 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:58.963 01:06:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:58.963 01:06:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:58.963 01:06:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:58.963 01:06:06 -- paths/export.sh@5 -- # export PATH 00:31:58.963 01:06:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:58.963 01:06:06 -- nvmf/common.sh@47 -- # : 0 00:31:58.963 01:06:06 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:31:58.963 01:06:06 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:31:58.963 01:06:06 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:31:58.963 01:06:06 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:58.963 01:06:06 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:58.963 01:06:06 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:31:58.963 01:06:06 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:31:58.963 01:06:06 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:31:58.963 01:06:06 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:31:58.963 01:06:06 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:31:58.963 01:06:06 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:31:58.963 01:06:06 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:31:58.963 01:06:06 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:31:58.963 01:06:06 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:31:58.963 01:06:06 -- host/auth.sh@21 -- # keys=() 00:31:58.963 01:06:06 -- host/auth.sh@77 -- # nvmftestinit 00:31:58.963 01:06:06 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:31:58.963 01:06:06 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:58.963 01:06:06 -- nvmf/common.sh@437 -- # prepare_net_devs 00:31:58.963 01:06:06 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:31:58.963 01:06:06 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:31:58.963 01:06:06 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:58.963 01:06:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:31:58.963 01:06:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:58.963 01:06:06 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:31:58.963 01:06:06 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:31:58.963 01:06:06 -- nvmf/common.sh@285 -- # xtrace_disable 00:31:58.963 01:06:06 -- common/autotest_common.sh@10 -- # set +x 00:32:04.236 01:06:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:04.236 01:06:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:32:04.236 01:06:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:32:04.236 01:06:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:32:04.236 01:06:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:32:04.236 01:06:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:32:04.236 01:06:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:32:04.236 01:06:10 -- nvmf/common.sh@295 -- # net_devs=() 00:32:04.237 01:06:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:32:04.237 01:06:10 -- nvmf/common.sh@296 -- # e810=() 00:32:04.237 01:06:10 -- nvmf/common.sh@296 -- # local -ga e810 00:32:04.237 01:06:10 -- nvmf/common.sh@297 -- # x722=() 00:32:04.237 01:06:10 -- nvmf/common.sh@297 -- # local -ga x722 00:32:04.237 01:06:10 -- nvmf/common.sh@298 -- # mlx=() 00:32:04.237 01:06:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:32:04.237 01:06:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:04.237 01:06:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:32:04.237 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:32:04.237 01:06:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:04.237 01:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:32:04.237 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:32:04.237 01:06:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:32:04.237 01:06:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:04.237 01:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:04.237 01:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:32:04.237 Found net devices under 0000:18:00.0: mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:04.237 01:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:04.237 01:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:32:04.237 Found net devices under 0000:18:00.1: mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:32:04.237 01:06:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:32:04.237 01:06:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:32:04.237 01:06:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:32:04.237 01:06:10 -- nvmf/common.sh@58 -- # uname 00:32:04.237 01:06:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:32:04.237 01:06:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:32:04.237 01:06:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:32:04.237 01:06:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:32:04.237 01:06:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:32:04.237 01:06:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:32:04.237 01:06:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:32:04.237 01:06:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:32:04.237 01:06:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:32:04.237 01:06:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:32:04.237 01:06:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:32:04.237 01:06:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:04.237 01:06:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:04.237 01:06:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:04.237 01:06:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:04.237 01:06:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@105 -- # continue 2 00:32:04.237 01:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@105 -- # continue 2 00:32:04.237 01:06:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:04.237 01:06:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:04.237 01:06:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:32:04.237 01:06:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:32:04.237 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:32:04.237 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:32:04.237 altname enp24s0f0np0 00:32:04.237 altname ens785f0np0 00:32:04.237 inet 192.168.100.8/24 scope global mlx_0_0 00:32:04.237 valid_lft forever preferred_lft forever 00:32:04.237 01:06:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:32:04.237 01:06:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:04.237 01:06:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:32:04.237 01:06:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:32:04.237 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:32:04.237 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:32:04.237 altname enp24s0f1np1 00:32:04.237 altname ens785f1np1 00:32:04.237 inet 192.168.100.9/24 scope global mlx_0_1 00:32:04.237 valid_lft forever preferred_lft forever 00:32:04.237 01:06:10 -- nvmf/common.sh@411 -- # return 0 00:32:04.237 01:06:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:32:04.237 01:06:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:32:04.237 01:06:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:32:04.237 01:06:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:32:04.237 01:06:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:32:04.237 01:06:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:32:04.237 01:06:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:32:04.237 01:06:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:32:04.237 01:06:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:32:04.237 01:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@105 -- # continue 2 00:32:04.237 01:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:32:04.237 01:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:32:04.237 01:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@105 -- # continue 2 00:32:04.237 01:06:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:04.237 01:06:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:04.237 01:06:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:32:04.237 01:06:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:32:04.237 01:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:32:04.238 01:06:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:32:04.238 192.168.100.9' 00:32:04.238 01:06:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:32:04.238 192.168.100.9' 00:32:04.238 01:06:10 -- nvmf/common.sh@446 -- # head -n 1 00:32:04.238 01:06:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:32:04.238 01:06:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:32:04.238 192.168.100.9' 00:32:04.238 01:06:10 -- nvmf/common.sh@447 -- # tail -n +2 00:32:04.238 01:06:10 -- nvmf/common.sh@447 -- # head -n 1 00:32:04.238 01:06:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:32:04.238 01:06:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:32:04.238 01:06:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:32:04.238 01:06:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:32:04.238 01:06:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:32:04.238 01:06:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:32:04.238 01:06:11 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:32:04.238 01:06:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:32:04.238 01:06:11 -- common/autotest_common.sh@710 -- # xtrace_disable 00:32:04.238 01:06:11 -- common/autotest_common.sh@10 -- # set +x 00:32:04.238 01:06:11 -- nvmf/common.sh@470 -- # nvmfpid=514849 00:32:04.238 01:06:11 -- nvmf/common.sh@471 -- # waitforlisten 514849 00:32:04.238 01:06:11 -- common/autotest_common.sh@817 -- # '[' -z 514849 ']' 00:32:04.238 01:06:11 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:04.238 01:06:11 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:04.238 01:06:11 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:04.238 01:06:11 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:04.238 01:06:11 -- common/autotest_common.sh@10 -- # set +x 00:32:04.238 01:06:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:32:04.807 01:06:11 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:04.807 01:06:11 -- common/autotest_common.sh@850 -- # return 0 00:32:04.807 01:06:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:32:04.807 01:06:11 -- common/autotest_common.sh@716 -- # xtrace_disable 00:32:04.807 01:06:11 -- common/autotest_common.sh@10 -- # set +x 00:32:04.807 01:06:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:04.807 01:06:11 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:32:04.807 01:06:11 -- host/auth.sh@81 -- # gen_key null 32 00:32:04.807 01:06:11 -- host/auth.sh@53 -- # local digest len file key 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # local -A digests 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # digest=null 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # len=32 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # key=4c70ebadfe2b46c5fa28884b3ca87f89 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.zVl 00:32:04.808 01:06:11 -- host/auth.sh@59 -- # format_dhchap_key 4c70ebadfe2b46c5fa28884b3ca87f89 0 00:32:04.808 01:06:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 4c70ebadfe2b46c5fa28884b3ca87f89 0 00:32:04.808 01:06:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # key=4c70ebadfe2b46c5fa28884b3ca87f89 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # digest=0 00:32:04.808 01:06:11 -- nvmf/common.sh@694 -- # python - 00:32:04.808 01:06:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.zVl 00:32:04.808 01:06:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.zVl 00:32:04.808 01:06:11 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.zVl 00:32:04.808 01:06:11 -- host/auth.sh@82 -- # gen_key null 48 00:32:04.808 01:06:11 -- host/auth.sh@53 -- # local digest len file key 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # local -A digests 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # digest=null 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # len=48 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # key=48bab0dd83c9e4c25d4f992b65910774d263e22bdb3cbd20 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.fjp 00:32:04.808 01:06:11 -- host/auth.sh@59 -- # format_dhchap_key 48bab0dd83c9e4c25d4f992b65910774d263e22bdb3cbd20 0 00:32:04.808 01:06:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 48bab0dd83c9e4c25d4f992b65910774d263e22bdb3cbd20 0 00:32:04.808 01:06:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # key=48bab0dd83c9e4c25d4f992b65910774d263e22bdb3cbd20 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # digest=0 00:32:04.808 01:06:11 -- nvmf/common.sh@694 -- # python - 00:32:04.808 01:06:11 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.fjp 00:32:04.808 01:06:11 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.fjp 00:32:04.808 01:06:11 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.fjp 00:32:04.808 01:06:11 -- host/auth.sh@83 -- # gen_key sha256 32 00:32:04.808 01:06:11 -- host/auth.sh@53 -- # local digest len file key 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:04.808 01:06:11 -- host/auth.sh@54 -- # local -A digests 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # digest=sha256 00:32:04.808 01:06:11 -- host/auth.sh@56 -- # len=32 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:32:04.808 01:06:11 -- host/auth.sh@57 -- # key=ad7779632b348e5333e4c4a54db8a94b 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:32:04.808 01:06:11 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.dl9 00:32:04.808 01:06:11 -- host/auth.sh@59 -- # format_dhchap_key ad7779632b348e5333e4c4a54db8a94b 1 00:32:04.808 01:06:11 -- nvmf/common.sh@708 -- # format_key DHHC-1 ad7779632b348e5333e4c4a54db8a94b 1 00:32:04.808 01:06:11 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # key=ad7779632b348e5333e4c4a54db8a94b 00:32:04.808 01:06:11 -- nvmf/common.sh@693 -- # digest=1 00:32:04.808 01:06:11 -- nvmf/common.sh@694 -- # python - 00:32:05.068 01:06:12 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.dl9 00:32:05.068 01:06:12 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.dl9 00:32:05.068 01:06:12 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.dl9 00:32:05.068 01:06:12 -- host/auth.sh@84 -- # gen_key sha384 48 00:32:05.068 01:06:12 -- host/auth.sh@53 -- # local digest len file key 00:32:05.068 01:06:12 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:05.068 01:06:12 -- host/auth.sh@54 -- # local -A digests 00:32:05.068 01:06:12 -- host/auth.sh@56 -- # digest=sha384 00:32:05.068 01:06:12 -- host/auth.sh@56 -- # len=48 00:32:05.068 01:06:12 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:32:05.068 01:06:12 -- host/auth.sh@57 -- # key=94e95fbc2e06b92cafc2c8fa90a7ca2a06c13de8692db69b 00:32:05.068 01:06:12 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:32:05.068 01:06:12 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.qeF 00:32:05.068 01:06:12 -- host/auth.sh@59 -- # format_dhchap_key 94e95fbc2e06b92cafc2c8fa90a7ca2a06c13de8692db69b 2 00:32:05.068 01:06:12 -- nvmf/common.sh@708 -- # format_key DHHC-1 94e95fbc2e06b92cafc2c8fa90a7ca2a06c13de8692db69b 2 00:32:05.068 01:06:12 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # key=94e95fbc2e06b92cafc2c8fa90a7ca2a06c13de8692db69b 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # digest=2 00:32:05.068 01:06:12 -- nvmf/common.sh@694 -- # python - 00:32:05.068 01:06:12 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.qeF 00:32:05.068 01:06:12 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.qeF 00:32:05.068 01:06:12 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.qeF 00:32:05.068 01:06:12 -- host/auth.sh@85 -- # gen_key sha512 64 00:32:05.068 01:06:12 -- host/auth.sh@53 -- # local digest len file key 00:32:05.068 01:06:12 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:32:05.068 01:06:12 -- host/auth.sh@54 -- # local -A digests 00:32:05.068 01:06:12 -- host/auth.sh@56 -- # digest=sha512 00:32:05.068 01:06:12 -- host/auth.sh@56 -- # len=64 00:32:05.068 01:06:12 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:32:05.068 01:06:12 -- host/auth.sh@57 -- # key=8c5d1a4fba7c7e8158cedff83e32bd9f24e27c622f990bd2098c955cf3ef863f 00:32:05.068 01:06:12 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:32:05.068 01:06:12 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.lTV 00:32:05.068 01:06:12 -- host/auth.sh@59 -- # format_dhchap_key 8c5d1a4fba7c7e8158cedff83e32bd9f24e27c622f990bd2098c955cf3ef863f 3 00:32:05.068 01:06:12 -- nvmf/common.sh@708 -- # format_key DHHC-1 8c5d1a4fba7c7e8158cedff83e32bd9f24e27c622f990bd2098c955cf3ef863f 3 00:32:05.068 01:06:12 -- nvmf/common.sh@691 -- # local prefix key digest 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # key=8c5d1a4fba7c7e8158cedff83e32bd9f24e27c622f990bd2098c955cf3ef863f 00:32:05.068 01:06:12 -- nvmf/common.sh@693 -- # digest=3 00:32:05.068 01:06:12 -- nvmf/common.sh@694 -- # python - 00:32:05.068 01:06:12 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.lTV 00:32:05.068 01:06:12 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.lTV 00:32:05.068 01:06:12 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.lTV 00:32:05.068 01:06:12 -- host/auth.sh@87 -- # waitforlisten 514849 00:32:05.068 01:06:12 -- common/autotest_common.sh@817 -- # '[' -z 514849 ']' 00:32:05.068 01:06:12 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:05.068 01:06:12 -- common/autotest_common.sh@822 -- # local max_retries=100 00:32:05.068 01:06:12 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:05.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:05.068 01:06:12 -- common/autotest_common.sh@826 -- # xtrace_disable 00:32:05.068 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:32:05.327 01:06:12 -- common/autotest_common.sh@850 -- # return 0 00:32:05.327 01:06:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:05.327 01:06:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.zVl 00:32:05.327 01:06:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.327 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.327 01:06:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:05.327 01:06:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.fjp 00:32:05.327 01:06:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.327 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.327 01:06:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:05.327 01:06:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.dl9 00:32:05.327 01:06:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.327 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.327 01:06:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:05.327 01:06:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.qeF 00:32:05.327 01:06:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.327 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.327 01:06:12 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:32:05.327 01:06:12 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.lTV 00:32:05.327 01:06:12 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:05.327 01:06:12 -- common/autotest_common.sh@10 -- # set +x 00:32:05.327 01:06:12 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:05.327 01:06:12 -- host/auth.sh@92 -- # nvmet_auth_init 00:32:05.327 01:06:12 -- host/auth.sh@35 -- # get_main_ns_ip 00:32:05.327 01:06:12 -- nvmf/common.sh@717 -- # local ip 00:32:05.327 01:06:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:05.327 01:06:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:05.327 01:06:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:05.327 01:06:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:05.327 01:06:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:05.327 01:06:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:05.327 01:06:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:05.327 01:06:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:05.327 01:06:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:05.328 01:06:12 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:32:05.328 01:06:12 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:32:05.328 01:06:12 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:32:05.328 01:06:12 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:05.328 01:06:12 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:05.328 01:06:12 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:05.328 01:06:12 -- nvmf/common.sh@628 -- # local block nvme 00:32:05.328 01:06:12 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:32:05.328 01:06:12 -- nvmf/common.sh@631 -- # modprobe nvmet 00:32:05.328 01:06:12 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:05.328 01:06:12 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:32:07.868 Waiting for block devices as requested 00:32:07.868 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:07.868 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:08.127 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:08.127 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:08.127 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:08.127 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:08.386 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:08.386 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:08.386 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:08.645 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:08.645 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:08.645 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:08.645 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:08.904 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:08.904 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:08.904 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:09.163 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:32:11.069 01:06:17 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:32:11.069 01:06:17 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:11.069 01:06:17 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:32:11.069 01:06:17 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:32:11.069 01:06:17 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:32:11.069 01:06:17 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:32:11.069 01:06:17 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:32:11.069 01:06:17 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:32:11.069 01:06:17 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:11.069 No valid GPT data, bailing 00:32:11.069 01:06:17 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:11.069 01:06:17 -- scripts/common.sh@391 -- # pt= 00:32:11.069 01:06:17 -- scripts/common.sh@392 -- # return 1 00:32:11.069 01:06:17 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:32:11.069 01:06:17 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:32:11.069 01:06:17 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:11.069 01:06:17 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:11.069 01:06:17 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:11.069 01:06:17 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:32:11.069 01:06:17 -- nvmf/common.sh@656 -- # echo 1 00:32:11.069 01:06:17 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:32:11.069 01:06:17 -- nvmf/common.sh@658 -- # echo 1 00:32:11.069 01:06:17 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:32:11.069 01:06:17 -- nvmf/common.sh@661 -- # echo rdma 00:32:11.069 01:06:17 -- nvmf/common.sh@662 -- # echo 4420 00:32:11.069 01:06:17 -- nvmf/common.sh@663 -- # echo ipv4 00:32:11.069 01:06:17 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:11.069 01:06:18 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 --hostid=00bafac1-9c9c-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:32:11.069 00:32:11.069 Discovery Log Number of Records 2, Generation counter 2 00:32:11.069 =====Discovery Log Entry 0====== 00:32:11.069 trtype: rdma 00:32:11.069 adrfam: ipv4 00:32:11.069 subtype: current discovery subsystem 00:32:11.069 treq: not specified, sq flow control disable supported 00:32:11.069 portid: 1 00:32:11.069 trsvcid: 4420 00:32:11.069 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:11.069 traddr: 192.168.100.8 00:32:11.069 eflags: none 00:32:11.069 rdma_prtype: not specified 00:32:11.069 rdma_qptype: connected 00:32:11.070 rdma_cms: rdma-cm 00:32:11.070 rdma_pkey: 0x0000 00:32:11.070 =====Discovery Log Entry 1====== 00:32:11.070 trtype: rdma 00:32:11.070 adrfam: ipv4 00:32:11.070 subtype: nvme subsystem 00:32:11.070 treq: not specified, sq flow control disable supported 00:32:11.070 portid: 1 00:32:11.070 trsvcid: 4420 00:32:11.070 subnqn: nqn.2024-02.io.spdk:cnode0 00:32:11.070 traddr: 192.168.100.8 00:32:11.070 eflags: none 00:32:11.070 rdma_prtype: not specified 00:32:11.070 rdma_qptype: connected 00:32:11.070 rdma_cms: rdma-cm 00:32:11.070 rdma_pkey: 0x0000 00:32:11.070 01:06:18 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:32:11.070 01:06:18 -- host/auth.sh@37 -- # echo 0 00:32:11.070 01:06:18 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:32:11.070 01:06:18 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:11.070 01:06:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.070 01:06:18 -- host/auth.sh@44 -- # digest=sha256 00:32:11.070 01:06:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.070 01:06:18 -- host/auth.sh@44 -- # keyid=1 00:32:11.070 01:06:18 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:11.070 01:06:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.070 01:06:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.070 01:06:18 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:11.070 01:06:18 -- host/auth.sh@100 -- # IFS=, 00:32:11.070 01:06:18 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:32:11.070 01:06:18 -- host/auth.sh@100 -- # IFS=, 00:32:11.070 01:06:18 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:11.070 01:06:18 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:32:11.070 01:06:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.070 01:06:18 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:32:11.070 01:06:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:11.070 01:06:18 -- host/auth.sh@68 -- # keyid=1 00:32:11.070 01:06:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:32:11.070 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.070 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.070 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.070 01:06:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.070 01:06:18 -- nvmf/common.sh@717 -- # local ip 00:32:11.070 01:06:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.070 01:06:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.070 01:06:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.070 01:06:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.070 01:06:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.070 01:06:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.070 01:06:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.070 01:06:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.070 01:06:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.070 01:06:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:11.070 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.070 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.330 nvme0n1 00:32:11.330 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.330 01:06:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.330 01:06:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.330 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.330 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.330 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.330 01:06:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.330 01:06:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.330 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.330 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.330 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.330 01:06:18 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:11.330 01:06:18 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:11.330 01:06:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.330 01:06:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:32:11.330 01:06:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.330 01:06:18 -- host/auth.sh@44 -- # digest=sha256 00:32:11.330 01:06:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.330 01:06:18 -- host/auth.sh@44 -- # keyid=0 00:32:11.330 01:06:18 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:11.330 01:06:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.330 01:06:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.330 01:06:18 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:11.330 01:06:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:32:11.330 01:06:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.330 01:06:18 -- host/auth.sh@68 -- # digest=sha256 00:32:11.330 01:06:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.330 01:06:18 -- host/auth.sh@68 -- # keyid=0 00:32:11.330 01:06:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.330 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.330 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.330 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.330 01:06:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.330 01:06:18 -- nvmf/common.sh@717 -- # local ip 00:32:11.330 01:06:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.330 01:06:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.330 01:06:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.330 01:06:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.330 01:06:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.330 01:06:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.330 01:06:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.330 01:06:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.330 01:06:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.330 01:06:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:11.330 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.330 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.590 nvme0n1 00:32:11.590 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.590 01:06:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.590 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.590 01:06:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.590 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.590 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.590 01:06:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.590 01:06:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.590 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.590 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.590 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.590 01:06:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.590 01:06:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:11.590 01:06:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.590 01:06:18 -- host/auth.sh@44 -- # digest=sha256 00:32:11.590 01:06:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.590 01:06:18 -- host/auth.sh@44 -- # keyid=1 00:32:11.590 01:06:18 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:11.590 01:06:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.590 01:06:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.590 01:06:18 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:11.590 01:06:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:32:11.590 01:06:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.590 01:06:18 -- host/auth.sh@68 -- # digest=sha256 00:32:11.590 01:06:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.590 01:06:18 -- host/auth.sh@68 -- # keyid=1 00:32:11.590 01:06:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.590 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.590 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.590 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.590 01:06:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.590 01:06:18 -- nvmf/common.sh@717 -- # local ip 00:32:11.590 01:06:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.590 01:06:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.590 01:06:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.590 01:06:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.590 01:06:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.590 01:06:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.590 01:06:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.590 01:06:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.591 01:06:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.591 01:06:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:11.591 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.591 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.851 nvme0n1 00:32:11.851 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.851 01:06:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:11.851 01:06:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:11.851 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.851 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.851 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.851 01:06:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:11.851 01:06:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:11.851 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.851 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.851 01:06:18 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.851 01:06:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:11.851 01:06:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:32:11.851 01:06:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:11.851 01:06:18 -- host/auth.sh@44 -- # digest=sha256 00:32:11.851 01:06:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:11.851 01:06:18 -- host/auth.sh@44 -- # keyid=2 00:32:11.851 01:06:18 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:11.851 01:06:18 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:11.851 01:06:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:11.851 01:06:18 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:11.851 01:06:18 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:32:11.851 01:06:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:11.851 01:06:18 -- host/auth.sh@68 -- # digest=sha256 00:32:11.851 01:06:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:11.851 01:06:18 -- host/auth.sh@68 -- # keyid=2 00:32:11.851 01:06:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:11.851 01:06:18 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.851 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:32:11.851 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:11.851 01:06:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:11.851 01:06:19 -- nvmf/common.sh@717 -- # local ip 00:32:11.851 01:06:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:11.851 01:06:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:11.851 01:06:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:11.851 01:06:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:11.851 01:06:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:11.851 01:06:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:11.851 01:06:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:11.851 01:06:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:11.851 01:06:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:11.851 01:06:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:11.851 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:11.851 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.111 nvme0n1 00:32:12.111 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.111 01:06:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.111 01:06:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.111 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.111 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.111 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.111 01:06:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.111 01:06:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.111 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.111 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.111 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.111 01:06:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.111 01:06:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:32:12.111 01:06:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.111 01:06:19 -- host/auth.sh@44 -- # digest=sha256 00:32:12.111 01:06:19 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:12.111 01:06:19 -- host/auth.sh@44 -- # keyid=3 00:32:12.111 01:06:19 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:12.111 01:06:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.111 01:06:19 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:12.111 01:06:19 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:12.111 01:06:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:32:12.111 01:06:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.112 01:06:19 -- host/auth.sh@68 -- # digest=sha256 00:32:12.112 01:06:19 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:12.112 01:06:19 -- host/auth.sh@68 -- # keyid=3 00:32:12.112 01:06:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:12.112 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.112 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.112 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.112 01:06:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.112 01:06:19 -- nvmf/common.sh@717 -- # local ip 00:32:12.112 01:06:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.112 01:06:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.112 01:06:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.112 01:06:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.112 01:06:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.112 01:06:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.112 01:06:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.112 01:06:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.112 01:06:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.112 01:06:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:12.112 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.112 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.373 nvme0n1 00:32:12.373 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.373 01:06:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.373 01:06:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.373 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.373 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.373 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.373 01:06:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.373 01:06:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.373 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.373 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.373 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.373 01:06:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.373 01:06:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:32:12.373 01:06:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.373 01:06:19 -- host/auth.sh@44 -- # digest=sha256 00:32:12.373 01:06:19 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:12.373 01:06:19 -- host/auth.sh@44 -- # keyid=4 00:32:12.373 01:06:19 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:12.373 01:06:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.373 01:06:19 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:12.373 01:06:19 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:12.373 01:06:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:32:12.373 01:06:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.373 01:06:19 -- host/auth.sh@68 -- # digest=sha256 00:32:12.373 01:06:19 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:12.373 01:06:19 -- host/auth.sh@68 -- # keyid=4 00:32:12.373 01:06:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:12.373 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.373 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.373 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.373 01:06:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.373 01:06:19 -- nvmf/common.sh@717 -- # local ip 00:32:12.373 01:06:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.373 01:06:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.373 01:06:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.373 01:06:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.373 01:06:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.373 01:06:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.373 01:06:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.373 01:06:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.373 01:06:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.373 01:06:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:12.373 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.373 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.633 nvme0n1 00:32:12.633 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.633 01:06:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:12.633 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.633 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.633 01:06:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:12.633 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.633 01:06:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:12.633 01:06:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:12.633 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.633 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.633 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.633 01:06:19 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:12.633 01:06:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:12.633 01:06:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:32:12.633 01:06:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:12.633 01:06:19 -- host/auth.sh@44 -- # digest=sha256 00:32:12.633 01:06:19 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:12.633 01:06:19 -- host/auth.sh@44 -- # keyid=0 00:32:12.633 01:06:19 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:12.633 01:06:19 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:12.633 01:06:19 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:12.893 01:06:19 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:12.893 01:06:19 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:32:12.893 01:06:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:12.893 01:06:19 -- host/auth.sh@68 -- # digest=sha256 00:32:12.893 01:06:19 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:12.893 01:06:19 -- host/auth.sh@68 -- # keyid=0 00:32:12.893 01:06:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:12.893 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.893 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:12.893 01:06:19 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:12.893 01:06:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:12.893 01:06:19 -- nvmf/common.sh@717 -- # local ip 00:32:12.893 01:06:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:12.893 01:06:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:12.893 01:06:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:12.893 01:06:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:12.893 01:06:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:12.893 01:06:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:12.893 01:06:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:12.893 01:06:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:12.893 01:06:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:12.893 01:06:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:12.893 01:06:19 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:12.893 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:32:13.153 nvme0n1 00:32:13.153 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.153 01:06:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.153 01:06:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.153 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.153 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.153 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.153 01:06:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.153 01:06:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.153 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.153 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.153 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.153 01:06:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.153 01:06:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:32:13.153 01:06:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.153 01:06:20 -- host/auth.sh@44 -- # digest=sha256 00:32:13.153 01:06:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.153 01:06:20 -- host/auth.sh@44 -- # keyid=1 00:32:13.153 01:06:20 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:13.153 01:06:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.153 01:06:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.153 01:06:20 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:13.153 01:06:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:32:13.153 01:06:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.153 01:06:20 -- host/auth.sh@68 -- # digest=sha256 00:32:13.153 01:06:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.153 01:06:20 -- host/auth.sh@68 -- # keyid=1 00:32:13.153 01:06:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.153 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.153 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.153 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.153 01:06:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.153 01:06:20 -- nvmf/common.sh@717 -- # local ip 00:32:13.153 01:06:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.153 01:06:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.153 01:06:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.153 01:06:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.153 01:06:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.153 01:06:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.153 01:06:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.153 01:06:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.153 01:06:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.153 01:06:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:13.153 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.153 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.413 nvme0n1 00:32:13.413 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.413 01:06:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.413 01:06:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.413 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.413 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.413 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.413 01:06:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.413 01:06:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.413 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.413 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.413 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.413 01:06:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.413 01:06:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:32:13.413 01:06:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.413 01:06:20 -- host/auth.sh@44 -- # digest=sha256 00:32:13.413 01:06:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.413 01:06:20 -- host/auth.sh@44 -- # keyid=2 00:32:13.413 01:06:20 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:13.413 01:06:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.413 01:06:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.413 01:06:20 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:13.413 01:06:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:32:13.413 01:06:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.413 01:06:20 -- host/auth.sh@68 -- # digest=sha256 00:32:13.413 01:06:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.413 01:06:20 -- host/auth.sh@68 -- # keyid=2 00:32:13.413 01:06:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.413 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.413 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.413 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.413 01:06:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.413 01:06:20 -- nvmf/common.sh@717 -- # local ip 00:32:13.413 01:06:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.413 01:06:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.413 01:06:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.413 01:06:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.413 01:06:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.413 01:06:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.413 01:06:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.413 01:06:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.413 01:06:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.413 01:06:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:13.413 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.413 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.673 nvme0n1 00:32:13.673 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.673 01:06:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.673 01:06:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.673 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.673 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.673 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.673 01:06:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.673 01:06:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.673 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.673 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.673 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.673 01:06:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.673 01:06:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:32:13.673 01:06:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.673 01:06:20 -- host/auth.sh@44 -- # digest=sha256 00:32:13.673 01:06:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.673 01:06:20 -- host/auth.sh@44 -- # keyid=3 00:32:13.673 01:06:20 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:13.673 01:06:20 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.673 01:06:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.673 01:06:20 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:13.673 01:06:20 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:32:13.673 01:06:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.673 01:06:20 -- host/auth.sh@68 -- # digest=sha256 00:32:13.673 01:06:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.673 01:06:20 -- host/auth.sh@68 -- # keyid=3 00:32:13.673 01:06:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.673 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.673 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.673 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.673 01:06:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.673 01:06:20 -- nvmf/common.sh@717 -- # local ip 00:32:13.673 01:06:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.673 01:06:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.673 01:06:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.673 01:06:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.673 01:06:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.673 01:06:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.673 01:06:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.673 01:06:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.673 01:06:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.673 01:06:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:13.673 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.673 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.933 nvme0n1 00:32:13.933 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.933 01:06:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:13.933 01:06:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:13.933 01:06:20 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.933 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:32:13.933 01:06:20 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.933 01:06:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:13.933 01:06:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:13.933 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.933 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:13.933 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.933 01:06:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:13.933 01:06:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:32:13.934 01:06:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:13.934 01:06:21 -- host/auth.sh@44 -- # digest=sha256 00:32:13.934 01:06:21 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:13.934 01:06:21 -- host/auth.sh@44 -- # keyid=4 00:32:13.934 01:06:21 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:13.934 01:06:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:13.934 01:06:21 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:13.934 01:06:21 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:13.934 01:06:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:32:13.934 01:06:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:13.934 01:06:21 -- host/auth.sh@68 -- # digest=sha256 00:32:13.934 01:06:21 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:13.934 01:06:21 -- host/auth.sh@68 -- # keyid=4 00:32:13.934 01:06:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:32:13.934 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.934 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:13.934 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:13.934 01:06:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:13.934 01:06:21 -- nvmf/common.sh@717 -- # local ip 00:32:13.934 01:06:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:13.934 01:06:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:13.934 01:06:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:13.934 01:06:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:13.934 01:06:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:13.934 01:06:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:13.934 01:06:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:13.934 01:06:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:13.934 01:06:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:13.934 01:06:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:13.934 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:13.934 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.194 nvme0n1 00:32:14.194 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.194 01:06:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.194 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.194 01:06:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.194 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.194 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.194 01:06:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:14.194 01:06:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:14.194 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.194 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.194 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.194 01:06:21 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:14.194 01:06:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:14.194 01:06:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:32:14.194 01:06:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:14.194 01:06:21 -- host/auth.sh@44 -- # digest=sha256 00:32:14.194 01:06:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:14.194 01:06:21 -- host/auth.sh@44 -- # keyid=0 00:32:14.194 01:06:21 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:14.194 01:06:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:14.194 01:06:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:14.764 01:06:21 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:14.764 01:06:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:32:14.764 01:06:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:14.764 01:06:21 -- host/auth.sh@68 -- # digest=sha256 00:32:14.764 01:06:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:14.764 01:06:21 -- host/auth.sh@68 -- # keyid=0 00:32:14.764 01:06:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:14.764 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.764 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.764 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.764 01:06:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:14.764 01:06:21 -- nvmf/common.sh@717 -- # local ip 00:32:14.764 01:06:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:14.764 01:06:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:14.764 01:06:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:14.764 01:06:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:14.764 01:06:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:14.764 01:06:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:14.764 01:06:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:14.764 01:06:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:14.764 01:06:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:14.764 01:06:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:14.764 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.764 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.764 nvme0n1 00:32:14.764 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:14.764 01:06:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:14.764 01:06:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:14.764 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:14.764 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:14.764 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.023 01:06:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.023 01:06:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.023 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.023 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:15.023 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.023 01:06:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.023 01:06:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:32:15.023 01:06:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.023 01:06:21 -- host/auth.sh@44 -- # digest=sha256 00:32:15.023 01:06:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:15.023 01:06:21 -- host/auth.sh@44 -- # keyid=1 00:32:15.023 01:06:21 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:15.023 01:06:21 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.023 01:06:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:15.023 01:06:21 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:15.023 01:06:21 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:32:15.023 01:06:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.023 01:06:21 -- host/auth.sh@68 -- # digest=sha256 00:32:15.023 01:06:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:15.024 01:06:21 -- host/auth.sh@68 -- # keyid=1 00:32:15.024 01:06:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:15.024 01:06:21 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.024 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:32:15.024 01:06:21 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.024 01:06:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.024 01:06:21 -- nvmf/common.sh@717 -- # local ip 00:32:15.024 01:06:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.024 01:06:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.024 01:06:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.024 01:06:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.024 01:06:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.024 01:06:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.024 01:06:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.024 01:06:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.024 01:06:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.024 01:06:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:15.024 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.024 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.283 nvme0n1 00:32:15.283 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.283 01:06:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.283 01:06:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.283 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.283 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.283 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.283 01:06:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.283 01:06:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.283 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.283 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.283 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.283 01:06:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.283 01:06:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:32:15.283 01:06:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.283 01:06:22 -- host/auth.sh@44 -- # digest=sha256 00:32:15.283 01:06:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:15.283 01:06:22 -- host/auth.sh@44 -- # keyid=2 00:32:15.283 01:06:22 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:15.283 01:06:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.283 01:06:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:15.284 01:06:22 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:15.284 01:06:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:32:15.284 01:06:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.284 01:06:22 -- host/auth.sh@68 -- # digest=sha256 00:32:15.284 01:06:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:15.284 01:06:22 -- host/auth.sh@68 -- # keyid=2 00:32:15.284 01:06:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:15.284 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.284 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.284 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.284 01:06:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.284 01:06:22 -- nvmf/common.sh@717 -- # local ip 00:32:15.284 01:06:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.284 01:06:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.284 01:06:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.284 01:06:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.284 01:06:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.284 01:06:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.284 01:06:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.284 01:06:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.284 01:06:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.284 01:06:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:15.284 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.284 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.544 nvme0n1 00:32:15.544 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.544 01:06:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.544 01:06:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.544 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.544 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.544 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.544 01:06:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.544 01:06:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.544 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.544 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.544 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.544 01:06:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.544 01:06:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:32:15.544 01:06:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.544 01:06:22 -- host/auth.sh@44 -- # digest=sha256 00:32:15.544 01:06:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:15.544 01:06:22 -- host/auth.sh@44 -- # keyid=3 00:32:15.544 01:06:22 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:15.544 01:06:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.544 01:06:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:15.544 01:06:22 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:15.544 01:06:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:32:15.544 01:06:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.544 01:06:22 -- host/auth.sh@68 -- # digest=sha256 00:32:15.544 01:06:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:15.544 01:06:22 -- host/auth.sh@68 -- # keyid=3 00:32:15.544 01:06:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:15.544 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.544 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.544 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.544 01:06:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.544 01:06:22 -- nvmf/common.sh@717 -- # local ip 00:32:15.544 01:06:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.544 01:06:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.544 01:06:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.544 01:06:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.544 01:06:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.544 01:06:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.544 01:06:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.544 01:06:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.544 01:06:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.544 01:06:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:15.544 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.544 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.803 nvme0n1 00:32:15.803 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.803 01:06:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:15.803 01:06:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:15.803 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.803 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.803 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.803 01:06:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:15.803 01:06:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:15.803 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.803 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.803 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.803 01:06:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:15.803 01:06:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:32:15.803 01:06:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:15.803 01:06:22 -- host/auth.sh@44 -- # digest=sha256 00:32:15.803 01:06:22 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:15.803 01:06:22 -- host/auth.sh@44 -- # keyid=4 00:32:15.803 01:06:22 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:15.803 01:06:22 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:15.803 01:06:22 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:15.803 01:06:22 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:15.803 01:06:22 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:32:15.803 01:06:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:15.803 01:06:22 -- host/auth.sh@68 -- # digest=sha256 00:32:15.803 01:06:22 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:15.803 01:06:22 -- host/auth.sh@68 -- # keyid=4 00:32:15.803 01:06:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:32:15.803 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.803 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:15.803 01:06:22 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:15.804 01:06:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:15.804 01:06:22 -- nvmf/common.sh@717 -- # local ip 00:32:15.804 01:06:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:15.804 01:06:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:15.804 01:06:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:15.804 01:06:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:15.804 01:06:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:15.804 01:06:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:15.804 01:06:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:15.804 01:06:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:15.804 01:06:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:15.804 01:06:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:15.804 01:06:22 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:15.804 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:32:16.062 nvme0n1 00:32:16.062 01:06:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.062 01:06:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:16.062 01:06:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:16.062 01:06:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.062 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:16.062 01:06:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.062 01:06:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:16.062 01:06:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:16.062 01:06:23 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:16.062 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:32:16.063 01:06:23 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:16.063 01:06:23 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:16.063 01:06:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:16.063 01:06:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:32:16.063 01:06:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:16.063 01:06:23 -- host/auth.sh@44 -- # digest=sha256 00:32:16.063 01:06:23 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:16.063 01:06:23 -- host/auth.sh@44 -- # keyid=0 00:32:16.063 01:06:23 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:16.063 01:06:23 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:16.063 01:06:23 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:17.441 01:06:24 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:17.441 01:06:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:32:17.441 01:06:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.441 01:06:24 -- host/auth.sh@68 -- # digest=sha256 00:32:17.441 01:06:24 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:17.441 01:06:24 -- host/auth.sh@68 -- # keyid=0 00:32:17.441 01:06:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:17.441 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.441 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:17.441 01:06:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.441 01:06:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.441 01:06:24 -- nvmf/common.sh@717 -- # local ip 00:32:17.441 01:06:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.441 01:06:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.441 01:06:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.441 01:06:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.441 01:06:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.441 01:06:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.441 01:06:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.441 01:06:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.441 01:06:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.441 01:06:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:17.441 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.441 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:17.700 nvme0n1 00:32:17.700 01:06:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.700 01:06:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:17.700 01:06:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:17.700 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.700 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:17.700 01:06:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.700 01:06:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:17.700 01:06:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:17.700 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.700 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:17.700 01:06:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.700 01:06:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:17.700 01:06:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:32:17.700 01:06:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:17.700 01:06:24 -- host/auth.sh@44 -- # digest=sha256 00:32:17.700 01:06:24 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:17.700 01:06:24 -- host/auth.sh@44 -- # keyid=1 00:32:17.700 01:06:24 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:17.700 01:06:24 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:17.700 01:06:24 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:17.700 01:06:24 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:17.700 01:06:24 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:32:17.700 01:06:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:17.700 01:06:24 -- host/auth.sh@68 -- # digest=sha256 00:32:17.700 01:06:24 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:17.700 01:06:24 -- host/auth.sh@68 -- # keyid=1 00:32:17.700 01:06:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:17.700 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.700 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:17.700 01:06:24 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:17.700 01:06:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:17.700 01:06:24 -- nvmf/common.sh@717 -- # local ip 00:32:17.700 01:06:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:17.700 01:06:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:17.700 01:06:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:17.700 01:06:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:17.700 01:06:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:17.700 01:06:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:17.700 01:06:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:17.700 01:06:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:17.700 01:06:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:17.700 01:06:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:17.700 01:06:24 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:17.700 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:32:18.268 nvme0n1 00:32:18.268 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.268 01:06:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.268 01:06:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.268 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.268 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.268 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.268 01:06:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.268 01:06:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.268 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.268 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.268 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.268 01:06:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.268 01:06:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:32:18.268 01:06:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.268 01:06:25 -- host/auth.sh@44 -- # digest=sha256 00:32:18.268 01:06:25 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:18.268 01:06:25 -- host/auth.sh@44 -- # keyid=2 00:32:18.268 01:06:25 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:18.268 01:06:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:18.268 01:06:25 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:18.268 01:06:25 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:18.269 01:06:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:32:18.269 01:06:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.269 01:06:25 -- host/auth.sh@68 -- # digest=sha256 00:32:18.269 01:06:25 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:18.269 01:06:25 -- host/auth.sh@68 -- # keyid=2 00:32:18.269 01:06:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:18.269 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.269 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.269 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.269 01:06:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.269 01:06:25 -- nvmf/common.sh@717 -- # local ip 00:32:18.269 01:06:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.269 01:06:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.269 01:06:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.269 01:06:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.269 01:06:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.269 01:06:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.269 01:06:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.269 01:06:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.269 01:06:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.269 01:06:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:18.269 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.269 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.528 nvme0n1 00:32:18.528 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.528 01:06:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:18.528 01:06:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:18.528 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.528 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.528 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.528 01:06:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:18.528 01:06:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:18.529 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.529 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.529 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.529 01:06:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:18.529 01:06:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:32:18.529 01:06:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:18.529 01:06:25 -- host/auth.sh@44 -- # digest=sha256 00:32:18.529 01:06:25 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:18.529 01:06:25 -- host/auth.sh@44 -- # keyid=3 00:32:18.529 01:06:25 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:18.529 01:06:25 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:18.529 01:06:25 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:18.529 01:06:25 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:18.529 01:06:25 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:32:18.529 01:06:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:18.529 01:06:25 -- host/auth.sh@68 -- # digest=sha256 00:32:18.529 01:06:25 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:18.529 01:06:25 -- host/auth.sh@68 -- # keyid=3 00:32:18.529 01:06:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:18.529 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.529 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:18.529 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:18.529 01:06:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:18.529 01:06:25 -- nvmf/common.sh@717 -- # local ip 00:32:18.529 01:06:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:18.529 01:06:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:18.529 01:06:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:18.529 01:06:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:18.529 01:06:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:18.529 01:06:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:18.529 01:06:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:18.529 01:06:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:18.529 01:06:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:18.529 01:06:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:18.529 01:06:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:18.529 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:32:19.097 nvme0n1 00:32:19.097 01:06:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.097 01:06:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:19.097 01:06:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:19.097 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.097 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.097 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.097 01:06:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:19.097 01:06:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:19.097 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.097 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.097 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.097 01:06:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:19.098 01:06:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:32:19.098 01:06:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:19.098 01:06:26 -- host/auth.sh@44 -- # digest=sha256 00:32:19.098 01:06:26 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:19.098 01:06:26 -- host/auth.sh@44 -- # keyid=4 00:32:19.098 01:06:26 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:19.098 01:06:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:19.098 01:06:26 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:19.098 01:06:26 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:19.098 01:06:26 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:32:19.098 01:06:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:19.098 01:06:26 -- host/auth.sh@68 -- # digest=sha256 00:32:19.098 01:06:26 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:19.098 01:06:26 -- host/auth.sh@68 -- # keyid=4 00:32:19.098 01:06:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:32:19.098 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.098 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.098 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.098 01:06:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:19.098 01:06:26 -- nvmf/common.sh@717 -- # local ip 00:32:19.098 01:06:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:19.098 01:06:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:19.098 01:06:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:19.098 01:06:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:19.098 01:06:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:19.098 01:06:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:19.098 01:06:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:19.098 01:06:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:19.098 01:06:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:19.098 01:06:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:19.098 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.098 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.358 nvme0n1 00:32:19.358 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.358 01:06:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:19.358 01:06:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:19.358 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.358 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.358 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.358 01:06:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:19.358 01:06:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:19.358 01:06:26 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:19.358 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:32:19.358 01:06:26 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:19.358 01:06:26 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:19.358 01:06:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:19.358 01:06:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:32:19.358 01:06:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:19.358 01:06:26 -- host/auth.sh@44 -- # digest=sha256 00:32:19.358 01:06:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:19.358 01:06:26 -- host/auth.sh@44 -- # keyid=0 00:32:19.358 01:06:26 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:19.358 01:06:26 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:19.358 01:06:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:21.897 01:06:29 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:21.897 01:06:29 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:32:21.897 01:06:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:21.897 01:06:29 -- host/auth.sh@68 -- # digest=sha256 00:32:21.897 01:06:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:21.897 01:06:29 -- host/auth.sh@68 -- # keyid=0 00:32:21.897 01:06:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:21.897 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:21.897 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:21.897 01:06:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:21.897 01:06:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:21.897 01:06:29 -- nvmf/common.sh@717 -- # local ip 00:32:21.897 01:06:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:21.897 01:06:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:21.897 01:06:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:21.897 01:06:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:21.897 01:06:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:21.897 01:06:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:21.897 01:06:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:21.897 01:06:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:21.897 01:06:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:21.897 01:06:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:21.898 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:21.898 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:22.467 nvme0n1 00:32:22.467 01:06:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.467 01:06:29 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:22.467 01:06:29 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:22.467 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.467 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:22.467 01:06:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.467 01:06:29 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:22.467 01:06:29 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:22.467 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.467 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:22.467 01:06:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.467 01:06:29 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:22.467 01:06:29 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:32:22.467 01:06:29 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:22.467 01:06:29 -- host/auth.sh@44 -- # digest=sha256 00:32:22.467 01:06:29 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:22.467 01:06:29 -- host/auth.sh@44 -- # keyid=1 00:32:22.467 01:06:29 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:22.467 01:06:29 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:22.467 01:06:29 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:22.467 01:06:29 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:22.467 01:06:29 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:32:22.467 01:06:29 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:22.467 01:06:29 -- host/auth.sh@68 -- # digest=sha256 00:32:22.467 01:06:29 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:22.467 01:06:29 -- host/auth.sh@68 -- # keyid=1 00:32:22.467 01:06:29 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:22.467 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.467 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:22.467 01:06:29 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:22.467 01:06:29 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:22.467 01:06:29 -- nvmf/common.sh@717 -- # local ip 00:32:22.467 01:06:29 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:22.467 01:06:29 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:22.467 01:06:29 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:22.467 01:06:29 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:22.467 01:06:29 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:22.467 01:06:29 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:22.467 01:06:29 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:22.467 01:06:29 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:22.467 01:06:29 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:22.467 01:06:29 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:22.467 01:06:29 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:22.467 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:32:23.037 nvme0n1 00:32:23.037 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.037 01:06:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:23.037 01:06:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:23.037 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.037 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.037 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.037 01:06:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:23.037 01:06:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:23.037 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.037 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.037 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.037 01:06:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:23.037 01:06:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:32:23.037 01:06:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:23.037 01:06:30 -- host/auth.sh@44 -- # digest=sha256 00:32:23.037 01:06:30 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:23.037 01:06:30 -- host/auth.sh@44 -- # keyid=2 00:32:23.037 01:06:30 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:23.037 01:06:30 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:23.037 01:06:30 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:23.037 01:06:30 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:23.037 01:06:30 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:32:23.037 01:06:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:23.037 01:06:30 -- host/auth.sh@68 -- # digest=sha256 00:32:23.037 01:06:30 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:23.037 01:06:30 -- host/auth.sh@68 -- # keyid=2 00:32:23.037 01:06:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:23.037 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.037 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.037 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.037 01:06:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:23.037 01:06:30 -- nvmf/common.sh@717 -- # local ip 00:32:23.037 01:06:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:23.037 01:06:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:23.037 01:06:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:23.037 01:06:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:23.037 01:06:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:23.037 01:06:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:23.037 01:06:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:23.037 01:06:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:23.037 01:06:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:23.037 01:06:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:23.037 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.037 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.607 nvme0n1 00:32:23.607 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.607 01:06:30 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:23.607 01:06:30 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:23.607 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.607 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.607 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.607 01:06:30 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:23.607 01:06:30 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:23.607 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.607 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.607 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.607 01:06:30 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:23.607 01:06:30 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:32:23.607 01:06:30 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:23.607 01:06:30 -- host/auth.sh@44 -- # digest=sha256 00:32:23.607 01:06:30 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:23.607 01:06:30 -- host/auth.sh@44 -- # keyid=3 00:32:23.607 01:06:30 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:23.607 01:06:30 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:23.607 01:06:30 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:23.607 01:06:30 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:23.607 01:06:30 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:32:23.607 01:06:30 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:23.607 01:06:30 -- host/auth.sh@68 -- # digest=sha256 00:32:23.607 01:06:30 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:23.607 01:06:30 -- host/auth.sh@68 -- # keyid=3 00:32:23.607 01:06:30 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:23.607 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.607 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:23.867 01:06:30 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:23.867 01:06:30 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:23.867 01:06:30 -- nvmf/common.sh@717 -- # local ip 00:32:23.867 01:06:30 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:23.867 01:06:30 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:23.867 01:06:30 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:23.867 01:06:30 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:23.867 01:06:30 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:23.867 01:06:30 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:23.867 01:06:30 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:23.867 01:06:30 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:23.867 01:06:30 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:23.867 01:06:30 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:23.867 01:06:30 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:23.867 01:06:30 -- common/autotest_common.sh@10 -- # set +x 00:32:24.436 nvme0n1 00:32:24.436 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.436 01:06:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:24.436 01:06:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:24.436 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.436 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:24.436 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.436 01:06:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:24.436 01:06:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:24.436 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.436 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:24.436 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.436 01:06:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:24.436 01:06:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:32:24.436 01:06:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:24.436 01:06:31 -- host/auth.sh@44 -- # digest=sha256 00:32:24.436 01:06:31 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:24.436 01:06:31 -- host/auth.sh@44 -- # keyid=4 00:32:24.436 01:06:31 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:24.436 01:06:31 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:24.436 01:06:31 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:24.436 01:06:31 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:24.436 01:06:31 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:32:24.436 01:06:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:24.436 01:06:31 -- host/auth.sh@68 -- # digest=sha256 00:32:24.436 01:06:31 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:24.436 01:06:31 -- host/auth.sh@68 -- # keyid=4 00:32:24.436 01:06:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:32:24.436 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.436 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:24.436 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:24.436 01:06:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:24.436 01:06:31 -- nvmf/common.sh@717 -- # local ip 00:32:24.436 01:06:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:24.436 01:06:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:24.436 01:06:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:24.436 01:06:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:24.436 01:06:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:24.436 01:06:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:24.436 01:06:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:24.436 01:06:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:24.436 01:06:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:24.436 01:06:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:24.436 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:24.436 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 nvme0n1 00:32:25.006 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.006 01:06:31 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.006 01:06:31 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.006 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.006 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.006 01:06:31 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.006 01:06:31 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.006 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.006 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.006 01:06:31 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:25.006 01:06:31 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:25.006 01:06:31 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.006 01:06:31 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:32:25.006 01:06:31 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.006 01:06:31 -- host/auth.sh@44 -- # digest=sha384 00:32:25.006 01:06:31 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.006 01:06:31 -- host/auth.sh@44 -- # keyid=0 00:32:25.006 01:06:31 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:25.006 01:06:31 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.006 01:06:31 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.006 01:06:31 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:25.006 01:06:31 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:32:25.006 01:06:31 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.006 01:06:31 -- host/auth.sh@68 -- # digest=sha384 00:32:25.006 01:06:31 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.006 01:06:31 -- host/auth.sh@68 -- # keyid=0 00:32:25.006 01:06:31 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.006 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.006 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 01:06:31 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.006 01:06:31 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.006 01:06:31 -- nvmf/common.sh@717 -- # local ip 00:32:25.006 01:06:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.006 01:06:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.006 01:06:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.006 01:06:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.006 01:06:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.006 01:06:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.006 01:06:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.006 01:06:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.006 01:06:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.006 01:06:31 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:25.006 01:06:31 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.006 01:06:31 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 nvme0n1 00:32:25.006 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.006 01:06:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.006 01:06:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.006 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.006 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.006 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.266 01:06:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.267 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.267 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.267 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.267 01:06:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:32:25.267 01:06:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.267 01:06:32 -- host/auth.sh@44 -- # digest=sha384 00:32:25.267 01:06:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.267 01:06:32 -- host/auth.sh@44 -- # keyid=1 00:32:25.267 01:06:32 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:25.267 01:06:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.267 01:06:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.267 01:06:32 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:25.267 01:06:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:32:25.267 01:06:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.267 01:06:32 -- host/auth.sh@68 -- # digest=sha384 00:32:25.267 01:06:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.267 01:06:32 -- host/auth.sh@68 -- # keyid=1 00:32:25.267 01:06:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.267 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.267 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.267 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.267 01:06:32 -- nvmf/common.sh@717 -- # local ip 00:32:25.267 01:06:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.267 01:06:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.267 01:06:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.267 01:06:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.267 01:06:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.267 01:06:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.267 01:06:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.267 01:06:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.267 01:06:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.267 01:06:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:25.267 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.267 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.267 nvme0n1 00:32:25.267 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.267 01:06:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.267 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.267 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.267 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.267 01:06:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.267 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.267 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.527 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.527 01:06:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:32:25.527 01:06:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # digest=sha384 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # keyid=2 00:32:25.527 01:06:32 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:25.527 01:06:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.527 01:06:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:25.527 01:06:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:32:25.527 01:06:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # digest=sha384 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # keyid=2 00:32:25.527 01:06:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.527 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.527 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.527 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.527 01:06:32 -- nvmf/common.sh@717 -- # local ip 00:32:25.527 01:06:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.527 01:06:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.527 01:06:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.527 01:06:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.527 01:06:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.527 01:06:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.527 01:06:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.527 01:06:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.527 01:06:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.527 01:06:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:25.527 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.527 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.527 nvme0n1 00:32:25.527 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.527 01:06:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.527 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.527 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.527 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.527 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.527 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.527 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.527 01:06:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.527 01:06:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:32:25.527 01:06:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # digest=sha384 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@44 -- # keyid=3 00:32:25.527 01:06:32 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:25.527 01:06:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.527 01:06:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:25.527 01:06:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:32:25.527 01:06:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # digest=sha384 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.527 01:06:32 -- host/auth.sh@68 -- # keyid=3 00:32:25.527 01:06:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.527 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.527 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.786 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.786 01:06:32 -- nvmf/common.sh@717 -- # local ip 00:32:25.786 01:06:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.786 01:06:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.786 01:06:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.786 01:06:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:25.786 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.786 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.786 nvme0n1 00:32:25.786 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:25.786 01:06:32 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:25.786 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.786 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.786 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:25.786 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.786 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.786 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:25.786 01:06:32 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:32:25.786 01:06:32 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:25.786 01:06:32 -- host/auth.sh@44 -- # digest=sha384 00:32:25.786 01:06:32 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:25.786 01:06:32 -- host/auth.sh@44 -- # keyid=4 00:32:25.786 01:06:32 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:25.786 01:06:32 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:25.786 01:06:32 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:25.786 01:06:32 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:25.786 01:06:32 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:32:25.786 01:06:32 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:25.786 01:06:32 -- host/auth.sh@68 -- # digest=sha384 00:32:25.786 01:06:32 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:25.786 01:06:32 -- host/auth.sh@68 -- # keyid=4 00:32:25.786 01:06:32 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:32:25.786 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.786 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:25.786 01:06:32 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:25.786 01:06:32 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:25.786 01:06:32 -- nvmf/common.sh@717 -- # local ip 00:32:25.786 01:06:32 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:25.786 01:06:32 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:25.786 01:06:32 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:25.786 01:06:32 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:25.786 01:06:32 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:25.786 01:06:32 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:25.786 01:06:32 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:25.786 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:32:26.044 nvme0n1 00:32:26.044 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.044 01:06:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.044 01:06:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.044 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.044 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.044 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.044 01:06:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.044 01:06:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.044 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.044 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.044 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.044 01:06:33 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:26.044 01:06:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.044 01:06:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:32:26.044 01:06:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.044 01:06:33 -- host/auth.sh@44 -- # digest=sha384 00:32:26.044 01:06:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.044 01:06:33 -- host/auth.sh@44 -- # keyid=0 00:32:26.044 01:06:33 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:26.044 01:06:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.044 01:06:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.044 01:06:33 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:26.044 01:06:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:32:26.044 01:06:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.044 01:06:33 -- host/auth.sh@68 -- # digest=sha384 00:32:26.045 01:06:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.045 01:06:33 -- host/auth.sh@68 -- # keyid=0 00:32:26.045 01:06:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.045 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.045 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.045 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.045 01:06:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.045 01:06:33 -- nvmf/common.sh@717 -- # local ip 00:32:26.045 01:06:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.045 01:06:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.045 01:06:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.045 01:06:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.045 01:06:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.045 01:06:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.045 01:06:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.045 01:06:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.045 01:06:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.045 01:06:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:26.045 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.045 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.304 nvme0n1 00:32:26.304 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.304 01:06:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.304 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.304 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.304 01:06:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.304 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.304 01:06:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.304 01:06:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.304 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.304 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.304 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.304 01:06:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.304 01:06:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:32:26.304 01:06:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.304 01:06:33 -- host/auth.sh@44 -- # digest=sha384 00:32:26.304 01:06:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.304 01:06:33 -- host/auth.sh@44 -- # keyid=1 00:32:26.304 01:06:33 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:26.304 01:06:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.304 01:06:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.304 01:06:33 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:26.304 01:06:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:32:26.304 01:06:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.304 01:06:33 -- host/auth.sh@68 -- # digest=sha384 00:32:26.304 01:06:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.304 01:06:33 -- host/auth.sh@68 -- # keyid=1 00:32:26.304 01:06:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.304 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.304 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.304 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.304 01:06:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.304 01:06:33 -- nvmf/common.sh@717 -- # local ip 00:32:26.304 01:06:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.304 01:06:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.304 01:06:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.304 01:06:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.304 01:06:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.304 01:06:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.304 01:06:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.304 01:06:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.304 01:06:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.304 01:06:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:26.304 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.304 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.563 nvme0n1 00:32:26.563 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.563 01:06:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.564 01:06:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.564 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.564 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.564 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.564 01:06:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.564 01:06:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.564 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.564 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.564 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.564 01:06:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.564 01:06:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:32:26.564 01:06:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.564 01:06:33 -- host/auth.sh@44 -- # digest=sha384 00:32:26.564 01:06:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.564 01:06:33 -- host/auth.sh@44 -- # keyid=2 00:32:26.564 01:06:33 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:26.564 01:06:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.564 01:06:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.564 01:06:33 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:26.564 01:06:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:32:26.564 01:06:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.564 01:06:33 -- host/auth.sh@68 -- # digest=sha384 00:32:26.564 01:06:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.564 01:06:33 -- host/auth.sh@68 -- # keyid=2 00:32:26.564 01:06:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.564 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.564 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.564 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.564 01:06:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.564 01:06:33 -- nvmf/common.sh@717 -- # local ip 00:32:26.564 01:06:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.564 01:06:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.564 01:06:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.564 01:06:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.564 01:06:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.564 01:06:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.564 01:06:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.564 01:06:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.564 01:06:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.564 01:06:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:26.564 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.564 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.823 nvme0n1 00:32:26.823 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.823 01:06:33 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:26.823 01:06:33 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:26.823 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.823 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.823 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.823 01:06:33 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:26.823 01:06:33 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:26.823 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.823 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.823 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.823 01:06:33 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:26.823 01:06:33 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:32:26.823 01:06:33 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:26.823 01:06:33 -- host/auth.sh@44 -- # digest=sha384 00:32:26.823 01:06:33 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:26.823 01:06:33 -- host/auth.sh@44 -- # keyid=3 00:32:26.823 01:06:33 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:26.823 01:06:33 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:26.823 01:06:33 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:26.823 01:06:33 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:26.823 01:06:33 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:32:26.823 01:06:33 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:26.823 01:06:33 -- host/auth.sh@68 -- # digest=sha384 00:32:26.823 01:06:33 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:26.823 01:06:33 -- host/auth.sh@68 -- # keyid=3 00:32:26.823 01:06:33 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:26.823 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.823 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:26.823 01:06:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:26.823 01:06:33 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:26.823 01:06:33 -- nvmf/common.sh@717 -- # local ip 00:32:26.823 01:06:33 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:26.823 01:06:33 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:26.823 01:06:33 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:26.823 01:06:33 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:26.823 01:06:33 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:26.823 01:06:33 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:26.823 01:06:33 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:26.823 01:06:33 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:26.823 01:06:33 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:26.823 01:06:33 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:26.823 01:06:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:26.823 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:32:27.083 nvme0n1 00:32:27.083 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.083 01:06:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.083 01:06:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.083 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.083 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.083 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.083 01:06:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.083 01:06:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.083 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.083 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.083 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.083 01:06:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.083 01:06:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:32:27.083 01:06:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.083 01:06:34 -- host/auth.sh@44 -- # digest=sha384 00:32:27.083 01:06:34 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:27.083 01:06:34 -- host/auth.sh@44 -- # keyid=4 00:32:27.083 01:06:34 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:27.083 01:06:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.083 01:06:34 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:27.083 01:06:34 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:27.083 01:06:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:32:27.083 01:06:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.083 01:06:34 -- host/auth.sh@68 -- # digest=sha384 00:32:27.083 01:06:34 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:27.083 01:06:34 -- host/auth.sh@68 -- # keyid=4 00:32:27.083 01:06:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:32:27.083 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.083 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.083 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.083 01:06:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.083 01:06:34 -- nvmf/common.sh@717 -- # local ip 00:32:27.083 01:06:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.083 01:06:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.083 01:06:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.083 01:06:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.083 01:06:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.083 01:06:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.083 01:06:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.083 01:06:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.083 01:06:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.083 01:06:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:27.083 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.083 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.342 nvme0n1 00:32:27.342 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.342 01:06:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.342 01:06:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.342 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.342 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.342 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.342 01:06:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.342 01:06:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.342 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.342 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.342 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.342 01:06:34 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:27.342 01:06:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.342 01:06:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:32:27.342 01:06:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.342 01:06:34 -- host/auth.sh@44 -- # digest=sha384 00:32:27.342 01:06:34 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:27.342 01:06:34 -- host/auth.sh@44 -- # keyid=0 00:32:27.342 01:06:34 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:27.342 01:06:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.342 01:06:34 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:27.342 01:06:34 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:27.342 01:06:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:32:27.342 01:06:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.342 01:06:34 -- host/auth.sh@68 -- # digest=sha384 00:32:27.342 01:06:34 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:27.342 01:06:34 -- host/auth.sh@68 -- # keyid=0 00:32:27.342 01:06:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:27.342 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.342 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.342 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.342 01:06:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.342 01:06:34 -- nvmf/common.sh@717 -- # local ip 00:32:27.342 01:06:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.342 01:06:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.342 01:06:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.342 01:06:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.342 01:06:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.342 01:06:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.342 01:06:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.342 01:06:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.342 01:06:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.342 01:06:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:27.342 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.342 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.602 nvme0n1 00:32:27.602 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.602 01:06:34 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:27.602 01:06:34 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:27.602 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.602 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.602 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.861 01:06:34 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:27.862 01:06:34 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:27.862 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.862 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.862 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.862 01:06:34 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:27.862 01:06:34 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:32:27.862 01:06:34 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:27.862 01:06:34 -- host/auth.sh@44 -- # digest=sha384 00:32:27.862 01:06:34 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:27.862 01:06:34 -- host/auth.sh@44 -- # keyid=1 00:32:27.862 01:06:34 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:27.862 01:06:34 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:27.862 01:06:34 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:27.862 01:06:34 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:27.862 01:06:34 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:32:27.862 01:06:34 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:27.862 01:06:34 -- host/auth.sh@68 -- # digest=sha384 00:32:27.862 01:06:34 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:27.862 01:06:34 -- host/auth.sh@68 -- # keyid=1 00:32:27.862 01:06:34 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:27.862 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.862 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:27.862 01:06:34 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:27.862 01:06:34 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:27.862 01:06:34 -- nvmf/common.sh@717 -- # local ip 00:32:27.862 01:06:34 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:27.862 01:06:34 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:27.862 01:06:34 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:27.862 01:06:34 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:27.862 01:06:34 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:27.862 01:06:34 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:27.862 01:06:34 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:27.862 01:06:34 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:27.862 01:06:34 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:27.862 01:06:34 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:27.862 01:06:34 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:27.862 01:06:34 -- common/autotest_common.sh@10 -- # set +x 00:32:28.121 nvme0n1 00:32:28.121 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.121 01:06:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.121 01:06:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.121 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.121 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.121 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.121 01:06:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.121 01:06:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.121 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.121 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.121 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.121 01:06:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.121 01:06:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:32:28.121 01:06:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.121 01:06:35 -- host/auth.sh@44 -- # digest=sha384 00:32:28.121 01:06:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.121 01:06:35 -- host/auth.sh@44 -- # keyid=2 00:32:28.121 01:06:35 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:28.121 01:06:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.121 01:06:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.121 01:06:35 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:28.121 01:06:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:32:28.121 01:06:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.121 01:06:35 -- host/auth.sh@68 -- # digest=sha384 00:32:28.121 01:06:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.121 01:06:35 -- host/auth.sh@68 -- # keyid=2 00:32:28.121 01:06:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.121 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.121 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.121 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.121 01:06:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.122 01:06:35 -- nvmf/common.sh@717 -- # local ip 00:32:28.122 01:06:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.122 01:06:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.122 01:06:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.122 01:06:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.122 01:06:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.122 01:06:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.122 01:06:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.122 01:06:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.122 01:06:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.122 01:06:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:28.122 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.122 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.381 nvme0n1 00:32:28.381 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.381 01:06:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.381 01:06:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.381 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.381 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.381 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.381 01:06:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.381 01:06:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.381 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.381 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.381 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.381 01:06:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.381 01:06:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:32:28.381 01:06:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.381 01:06:35 -- host/auth.sh@44 -- # digest=sha384 00:32:28.381 01:06:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.381 01:06:35 -- host/auth.sh@44 -- # keyid=3 00:32:28.381 01:06:35 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:28.381 01:06:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.381 01:06:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.381 01:06:35 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:28.381 01:06:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:32:28.381 01:06:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.381 01:06:35 -- host/auth.sh@68 -- # digest=sha384 00:32:28.381 01:06:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.381 01:06:35 -- host/auth.sh@68 -- # keyid=3 00:32:28.381 01:06:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.381 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.381 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.381 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.381 01:06:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.381 01:06:35 -- nvmf/common.sh@717 -- # local ip 00:32:28.381 01:06:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.381 01:06:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.381 01:06:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.381 01:06:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.381 01:06:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.381 01:06:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.381 01:06:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.381 01:06:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.381 01:06:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.381 01:06:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:28.381 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.381 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.641 nvme0n1 00:32:28.641 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.641 01:06:35 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.641 01:06:35 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.641 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.641 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.641 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.641 01:06:35 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.641 01:06:35 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.641 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.641 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.641 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.641 01:06:35 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.641 01:06:35 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:32:28.641 01:06:35 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.641 01:06:35 -- host/auth.sh@44 -- # digest=sha384 00:32:28.641 01:06:35 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:28.641 01:06:35 -- host/auth.sh@44 -- # keyid=4 00:32:28.641 01:06:35 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:28.641 01:06:35 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.641 01:06:35 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:28.641 01:06:35 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:28.641 01:06:35 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:32:28.641 01:06:35 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.641 01:06:35 -- host/auth.sh@68 -- # digest=sha384 00:32:28.641 01:06:35 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:28.641 01:06:35 -- host/auth.sh@68 -- # keyid=4 00:32:28.641 01:06:35 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:32:28.641 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.641 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.641 01:06:35 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.641 01:06:35 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.641 01:06:35 -- nvmf/common.sh@717 -- # local ip 00:32:28.641 01:06:35 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.641 01:06:35 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.641 01:06:35 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.641 01:06:35 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.641 01:06:35 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.641 01:06:35 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.641 01:06:35 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.641 01:06:35 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.641 01:06:35 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.641 01:06:35 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:28.641 01:06:35 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.641 01:06:35 -- common/autotest_common.sh@10 -- # set +x 00:32:28.900 nvme0n1 00:32:28.901 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.901 01:06:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:28.901 01:06:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:28.901 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.901 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:28.901 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.901 01:06:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:28.901 01:06:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:28.901 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.901 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:28.901 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.901 01:06:36 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:28.901 01:06:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:28.901 01:06:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:32:28.901 01:06:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:28.901 01:06:36 -- host/auth.sh@44 -- # digest=sha384 00:32:28.901 01:06:36 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:28.901 01:06:36 -- host/auth.sh@44 -- # keyid=0 00:32:28.901 01:06:36 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:28.901 01:06:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:28.901 01:06:36 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:28.901 01:06:36 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:28.901 01:06:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:32:28.901 01:06:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:28.901 01:06:36 -- host/auth.sh@68 -- # digest=sha384 00:32:28.901 01:06:36 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:28.901 01:06:36 -- host/auth.sh@68 -- # keyid=0 00:32:28.901 01:06:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:28.901 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.901 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:28.901 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:28.901 01:06:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:28.901 01:06:36 -- nvmf/common.sh@717 -- # local ip 00:32:28.901 01:06:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:28.901 01:06:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:28.901 01:06:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:28.901 01:06:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:28.901 01:06:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:28.901 01:06:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:28.901 01:06:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:28.901 01:06:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:28.901 01:06:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:28.901 01:06:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:28.901 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:28.901 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.469 nvme0n1 00:32:29.469 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.469 01:06:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:29.469 01:06:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:29.469 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.469 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.469 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.469 01:06:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:29.469 01:06:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:29.469 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.469 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.469 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.469 01:06:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:29.469 01:06:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:32:29.469 01:06:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:29.469 01:06:36 -- host/auth.sh@44 -- # digest=sha384 00:32:29.469 01:06:36 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:29.469 01:06:36 -- host/auth.sh@44 -- # keyid=1 00:32:29.469 01:06:36 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:29.469 01:06:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:29.469 01:06:36 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:29.469 01:06:36 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:29.469 01:06:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:32:29.469 01:06:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:29.469 01:06:36 -- host/auth.sh@68 -- # digest=sha384 00:32:29.469 01:06:36 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:29.469 01:06:36 -- host/auth.sh@68 -- # keyid=1 00:32:29.469 01:06:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:29.469 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.470 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.470 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.470 01:06:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:29.470 01:06:36 -- nvmf/common.sh@717 -- # local ip 00:32:29.470 01:06:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:29.470 01:06:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:29.470 01:06:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:29.470 01:06:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:29.470 01:06:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:29.470 01:06:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:29.470 01:06:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:29.470 01:06:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:29.470 01:06:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:29.470 01:06:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:29.470 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.470 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.730 nvme0n1 00:32:29.730 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.730 01:06:36 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:29.730 01:06:36 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:29.730 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.730 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.730 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.730 01:06:36 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:29.730 01:06:36 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:29.730 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.730 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.730 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.730 01:06:36 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:29.730 01:06:36 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:32:29.730 01:06:36 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:29.730 01:06:36 -- host/auth.sh@44 -- # digest=sha384 00:32:29.730 01:06:36 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:29.730 01:06:36 -- host/auth.sh@44 -- # keyid=2 00:32:29.730 01:06:36 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:29.730 01:06:36 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:29.730 01:06:36 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:29.730 01:06:36 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:29.730 01:06:36 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:32:29.730 01:06:36 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:29.730 01:06:36 -- host/auth.sh@68 -- # digest=sha384 00:32:29.730 01:06:36 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:29.730 01:06:36 -- host/auth.sh@68 -- # keyid=2 00:32:29.730 01:06:36 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:29.730 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.730 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:29.989 01:06:36 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:29.989 01:06:36 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:29.989 01:06:36 -- nvmf/common.sh@717 -- # local ip 00:32:29.989 01:06:36 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:29.989 01:06:36 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:29.989 01:06:36 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:29.989 01:06:36 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:29.989 01:06:36 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:29.989 01:06:36 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:29.989 01:06:36 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:29.989 01:06:36 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:29.989 01:06:36 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:29.989 01:06:36 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:29.989 01:06:36 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:29.989 01:06:36 -- common/autotest_common.sh@10 -- # set +x 00:32:30.248 nvme0n1 00:32:30.248 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.248 01:06:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:30.248 01:06:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:30.248 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.248 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.248 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.248 01:06:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:30.248 01:06:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:30.248 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.248 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.248 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.248 01:06:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:30.248 01:06:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:32:30.248 01:06:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:30.248 01:06:37 -- host/auth.sh@44 -- # digest=sha384 00:32:30.248 01:06:37 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:30.248 01:06:37 -- host/auth.sh@44 -- # keyid=3 00:32:30.248 01:06:37 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:30.248 01:06:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:30.248 01:06:37 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:30.248 01:06:37 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:30.249 01:06:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:32:30.249 01:06:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:30.249 01:06:37 -- host/auth.sh@68 -- # digest=sha384 00:32:30.249 01:06:37 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:30.249 01:06:37 -- host/auth.sh@68 -- # keyid=3 00:32:30.249 01:06:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:30.249 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.249 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.249 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.249 01:06:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:30.249 01:06:37 -- nvmf/common.sh@717 -- # local ip 00:32:30.249 01:06:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:30.249 01:06:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:30.249 01:06:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:30.249 01:06:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:30.249 01:06:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:30.249 01:06:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:30.249 01:06:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:30.249 01:06:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:30.249 01:06:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:30.249 01:06:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:30.249 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.249 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.508 nvme0n1 00:32:30.508 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.508 01:06:37 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:30.508 01:06:37 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:30.508 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.508 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.769 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.769 01:06:37 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:30.769 01:06:37 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:30.769 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.769 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.769 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.769 01:06:37 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:30.769 01:06:37 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:32:30.769 01:06:37 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:30.769 01:06:37 -- host/auth.sh@44 -- # digest=sha384 00:32:30.769 01:06:37 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:30.769 01:06:37 -- host/auth.sh@44 -- # keyid=4 00:32:30.769 01:06:37 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:30.769 01:06:37 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:30.769 01:06:37 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:30.769 01:06:37 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:30.769 01:06:37 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:32:30.769 01:06:37 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:30.769 01:06:37 -- host/auth.sh@68 -- # digest=sha384 00:32:30.769 01:06:37 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:30.769 01:06:37 -- host/auth.sh@68 -- # keyid=4 00:32:30.769 01:06:37 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:32:30.769 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.769 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:30.769 01:06:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:30.769 01:06:37 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:30.769 01:06:37 -- nvmf/common.sh@717 -- # local ip 00:32:30.770 01:06:37 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:30.770 01:06:37 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:30.770 01:06:37 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:30.770 01:06:37 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:30.770 01:06:37 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:30.770 01:06:37 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:30.770 01:06:37 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:30.770 01:06:37 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:30.770 01:06:37 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:30.770 01:06:37 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:30.770 01:06:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:30.770 01:06:37 -- common/autotest_common.sh@10 -- # set +x 00:32:31.030 nvme0n1 00:32:31.030 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.030 01:06:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:31.030 01:06:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:31.030 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.030 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.030 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.030 01:06:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:31.030 01:06:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:31.030 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.030 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.030 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.030 01:06:38 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:31.030 01:06:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:31.030 01:06:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:32:31.030 01:06:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:31.030 01:06:38 -- host/auth.sh@44 -- # digest=sha384 00:32:31.030 01:06:38 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:31.030 01:06:38 -- host/auth.sh@44 -- # keyid=0 00:32:31.030 01:06:38 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:31.030 01:06:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:31.030 01:06:38 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:31.030 01:06:38 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:31.030 01:06:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:32:31.030 01:06:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:31.030 01:06:38 -- host/auth.sh@68 -- # digest=sha384 00:32:31.030 01:06:38 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:31.030 01:06:38 -- host/auth.sh@68 -- # keyid=0 00:32:31.030 01:06:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:31.030 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.030 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.030 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.030 01:06:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:31.030 01:06:38 -- nvmf/common.sh@717 -- # local ip 00:32:31.030 01:06:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:31.030 01:06:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:31.030 01:06:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:31.030 01:06:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:31.030 01:06:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:31.030 01:06:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:31.030 01:06:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:31.030 01:06:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:31.030 01:06:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:31.030 01:06:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:31.030 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.030 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.601 nvme0n1 00:32:31.601 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.601 01:06:38 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:31.601 01:06:38 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:31.601 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.601 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.601 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.601 01:06:38 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:31.601 01:06:38 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:31.601 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.601 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.601 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.601 01:06:38 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:31.601 01:06:38 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:32:31.601 01:06:38 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:31.601 01:06:38 -- host/auth.sh@44 -- # digest=sha384 00:32:31.601 01:06:38 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:31.601 01:06:38 -- host/auth.sh@44 -- # keyid=1 00:32:31.601 01:06:38 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:31.601 01:06:38 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:31.601 01:06:38 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:31.601 01:06:38 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:31.601 01:06:38 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:32:31.601 01:06:38 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:31.601 01:06:38 -- host/auth.sh@68 -- # digest=sha384 00:32:31.601 01:06:38 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:31.601 01:06:38 -- host/auth.sh@68 -- # keyid=1 00:32:31.601 01:06:38 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:31.601 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.601 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:31.601 01:06:38 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:31.601 01:06:38 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:31.601 01:06:38 -- nvmf/common.sh@717 -- # local ip 00:32:31.601 01:06:38 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:31.601 01:06:38 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:31.601 01:06:38 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:31.601 01:06:38 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:31.601 01:06:38 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:31.601 01:06:38 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:31.601 01:06:38 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:31.601 01:06:38 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:31.601 01:06:38 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:31.601 01:06:38 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:31.601 01:06:38 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:31.601 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:32:32.171 nvme0n1 00:32:32.171 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.171 01:06:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:32.171 01:06:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:32.171 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.171 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:32.171 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.171 01:06:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:32.171 01:06:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:32.171 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.171 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:32.171 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.171 01:06:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:32.171 01:06:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:32:32.171 01:06:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:32.171 01:06:39 -- host/auth.sh@44 -- # digest=sha384 00:32:32.171 01:06:39 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:32.171 01:06:39 -- host/auth.sh@44 -- # keyid=2 00:32:32.171 01:06:39 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:32.171 01:06:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:32.171 01:06:39 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:32.171 01:06:39 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:32.171 01:06:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:32:32.171 01:06:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:32.171 01:06:39 -- host/auth.sh@68 -- # digest=sha384 00:32:32.171 01:06:39 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:32.171 01:06:39 -- host/auth.sh@68 -- # keyid=2 00:32:32.171 01:06:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:32.171 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.171 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:32.430 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:32.430 01:06:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:32.430 01:06:39 -- nvmf/common.sh@717 -- # local ip 00:32:32.430 01:06:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:32.430 01:06:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:32.430 01:06:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:32.430 01:06:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:32.431 01:06:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:32.431 01:06:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:32.431 01:06:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:32.431 01:06:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:32.431 01:06:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:32.431 01:06:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:32.431 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:32.431 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:33.000 nvme0n1 00:32:33.000 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.000 01:06:39 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:33.000 01:06:39 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:33.000 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.000 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:33.000 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.000 01:06:39 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:33.000 01:06:39 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:33.000 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.000 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:33.000 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.001 01:06:39 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:33.001 01:06:39 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:32:33.001 01:06:39 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:33.001 01:06:39 -- host/auth.sh@44 -- # digest=sha384 00:32:33.001 01:06:39 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:33.001 01:06:39 -- host/auth.sh@44 -- # keyid=3 00:32:33.001 01:06:39 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:33.001 01:06:39 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:33.001 01:06:39 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:33.001 01:06:39 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:33.001 01:06:39 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:32:33.001 01:06:39 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:33.001 01:06:39 -- host/auth.sh@68 -- # digest=sha384 00:32:33.001 01:06:39 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:33.001 01:06:39 -- host/auth.sh@68 -- # keyid=3 00:32:33.001 01:06:39 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:33.001 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.001 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:33.001 01:06:39 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.001 01:06:39 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:33.001 01:06:39 -- nvmf/common.sh@717 -- # local ip 00:32:33.001 01:06:39 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:33.001 01:06:39 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:33.001 01:06:39 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:33.001 01:06:39 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:33.001 01:06:39 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:33.001 01:06:39 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:33.001 01:06:39 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:33.001 01:06:39 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:33.001 01:06:39 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:33.001 01:06:39 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:33.001 01:06:39 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.001 01:06:39 -- common/autotest_common.sh@10 -- # set +x 00:32:33.571 nvme0n1 00:32:33.571 01:06:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.571 01:06:40 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:33.571 01:06:40 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:33.571 01:06:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.571 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:32:33.571 01:06:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.571 01:06:40 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:33.571 01:06:40 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:33.571 01:06:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.571 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:32:33.571 01:06:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.571 01:06:40 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:33.571 01:06:40 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:32:33.571 01:06:40 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:33.571 01:06:40 -- host/auth.sh@44 -- # digest=sha384 00:32:33.571 01:06:40 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:33.571 01:06:40 -- host/auth.sh@44 -- # keyid=4 00:32:33.571 01:06:40 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:33.571 01:06:40 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:32:33.571 01:06:40 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:33.571 01:06:40 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:33.571 01:06:40 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:32:33.571 01:06:40 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:33.571 01:06:40 -- host/auth.sh@68 -- # digest=sha384 00:32:33.571 01:06:40 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:33.571 01:06:40 -- host/auth.sh@68 -- # keyid=4 00:32:33.571 01:06:40 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:32:33.571 01:06:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.571 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:32:33.571 01:06:40 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:33.571 01:06:40 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:33.571 01:06:40 -- nvmf/common.sh@717 -- # local ip 00:32:33.571 01:06:40 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:33.571 01:06:40 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:33.571 01:06:40 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:33.571 01:06:40 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:33.571 01:06:40 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:33.571 01:06:40 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:33.571 01:06:40 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:33.571 01:06:40 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:33.571 01:06:40 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:33.571 01:06:40 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:33.571 01:06:40 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:33.571 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:32:34.141 nvme0n1 00:32:34.141 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.141 01:06:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.141 01:06:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.141 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.141 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.141 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.141 01:06:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.141 01:06:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.141 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.141 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.141 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.141 01:06:41 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:32:34.141 01:06:41 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:34.141 01:06:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.141 01:06:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:32:34.141 01:06:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.141 01:06:41 -- host/auth.sh@44 -- # digest=sha512 00:32:34.141 01:06:41 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.141 01:06:41 -- host/auth.sh@44 -- # keyid=0 00:32:34.141 01:06:41 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:34.141 01:06:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.141 01:06:41 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.141 01:06:41 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:34.141 01:06:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:32:34.141 01:06:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.141 01:06:41 -- host/auth.sh@68 -- # digest=sha512 00:32:34.141 01:06:41 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.141 01:06:41 -- host/auth.sh@68 -- # keyid=0 00:32:34.141 01:06:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.141 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.141 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.141 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.141 01:06:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.141 01:06:41 -- nvmf/common.sh@717 -- # local ip 00:32:34.141 01:06:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.141 01:06:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.141 01:06:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.141 01:06:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.141 01:06:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.141 01:06:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.141 01:06:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.141 01:06:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.141 01:06:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.141 01:06:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:34.141 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.141 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.401 nvme0n1 00:32:34.401 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.401 01:06:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.401 01:06:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.401 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.401 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.401 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.401 01:06:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.401 01:06:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.401 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.401 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.401 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.401 01:06:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.401 01:06:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:32:34.401 01:06:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.401 01:06:41 -- host/auth.sh@44 -- # digest=sha512 00:32:34.401 01:06:41 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.401 01:06:41 -- host/auth.sh@44 -- # keyid=1 00:32:34.401 01:06:41 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:34.401 01:06:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.401 01:06:41 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.401 01:06:41 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:34.401 01:06:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:32:34.401 01:06:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.401 01:06:41 -- host/auth.sh@68 -- # digest=sha512 00:32:34.401 01:06:41 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.401 01:06:41 -- host/auth.sh@68 -- # keyid=1 00:32:34.401 01:06:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.401 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.401 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.401 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.401 01:06:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.401 01:06:41 -- nvmf/common.sh@717 -- # local ip 00:32:34.401 01:06:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.401 01:06:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.401 01:06:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.401 01:06:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.401 01:06:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.401 01:06:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.401 01:06:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.401 01:06:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.401 01:06:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.401 01:06:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:34.401 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.401 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.662 nvme0n1 00:32:34.662 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.662 01:06:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.662 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.662 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.662 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.662 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.662 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.662 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.662 01:06:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:32:34.662 01:06:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.662 01:06:41 -- host/auth.sh@44 -- # digest=sha512 00:32:34.662 01:06:41 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.662 01:06:41 -- host/auth.sh@44 -- # keyid=2 00:32:34.662 01:06:41 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:34.662 01:06:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.662 01:06:41 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.662 01:06:41 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:34.662 01:06:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:32:34.662 01:06:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.662 01:06:41 -- host/auth.sh@68 -- # digest=sha512 00:32:34.662 01:06:41 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.662 01:06:41 -- host/auth.sh@68 -- # keyid=2 00:32:34.662 01:06:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.662 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.662 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.662 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.662 01:06:41 -- nvmf/common.sh@717 -- # local ip 00:32:34.662 01:06:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.662 01:06:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.662 01:06:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.662 01:06:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.662 01:06:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.662 01:06:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.662 01:06:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.662 01:06:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.662 01:06:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.662 01:06:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:34.662 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.662 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.662 nvme0n1 00:32:34.662 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.662 01:06:41 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.662 01:06:41 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.662 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.662 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.922 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.922 01:06:41 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:34.922 01:06:41 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:34.922 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.922 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.922 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.922 01:06:41 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:34.922 01:06:41 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:32:34.922 01:06:41 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:34.922 01:06:41 -- host/auth.sh@44 -- # digest=sha512 00:32:34.922 01:06:41 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:34.922 01:06:41 -- host/auth.sh@44 -- # keyid=3 00:32:34.922 01:06:41 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:34.922 01:06:41 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:34.922 01:06:41 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:34.922 01:06:41 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:34.922 01:06:41 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:32:34.922 01:06:41 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:34.922 01:06:41 -- host/auth.sh@68 -- # digest=sha512 00:32:34.922 01:06:41 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:34.922 01:06:41 -- host/auth.sh@68 -- # keyid=3 00:32:34.922 01:06:41 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:34.922 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.922 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.922 01:06:41 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.922 01:06:41 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:34.922 01:06:41 -- nvmf/common.sh@717 -- # local ip 00:32:34.922 01:06:41 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:34.922 01:06:41 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:34.922 01:06:41 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:34.922 01:06:41 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:34.922 01:06:41 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:34.922 01:06:41 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:34.922 01:06:41 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:34.922 01:06:41 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:34.922 01:06:41 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:34.922 01:06:41 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:34.922 01:06:41 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.922 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:32:34.922 nvme0n1 00:32:34.922 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:34.922 01:06:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:34.922 01:06:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:34.923 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:34.923 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:34.923 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.182 01:06:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.182 01:06:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.182 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.182 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.182 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.182 01:06:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.182 01:06:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:32:35.182 01:06:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.183 01:06:42 -- host/auth.sh@44 -- # digest=sha512 00:32:35.183 01:06:42 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:35.183 01:06:42 -- host/auth.sh@44 -- # keyid=4 00:32:35.183 01:06:42 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:35.183 01:06:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.183 01:06:42 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:35.183 01:06:42 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:35.183 01:06:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:32:35.183 01:06:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.183 01:06:42 -- host/auth.sh@68 -- # digest=sha512 00:32:35.183 01:06:42 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:32:35.183 01:06:42 -- host/auth.sh@68 -- # keyid=4 00:32:35.183 01:06:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:32:35.183 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.183 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.183 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.183 01:06:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.183 01:06:42 -- nvmf/common.sh@717 -- # local ip 00:32:35.183 01:06:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.183 01:06:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.183 01:06:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.183 01:06:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.183 01:06:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.183 01:06:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.183 01:06:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.183 01:06:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.183 01:06:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.183 01:06:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:35.183 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.183 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.183 nvme0n1 00:32:35.183 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.183 01:06:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.183 01:06:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.183 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.183 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.183 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.442 01:06:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.443 01:06:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.443 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.443 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.443 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.443 01:06:42 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:35.443 01:06:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.443 01:06:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:32:35.443 01:06:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.443 01:06:42 -- host/auth.sh@44 -- # digest=sha512 00:32:35.443 01:06:42 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:35.443 01:06:42 -- host/auth.sh@44 -- # keyid=0 00:32:35.443 01:06:42 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:35.443 01:06:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.443 01:06:42 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:35.443 01:06:42 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:35.443 01:06:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:32:35.443 01:06:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.443 01:06:42 -- host/auth.sh@68 -- # digest=sha512 00:32:35.443 01:06:42 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:35.443 01:06:42 -- host/auth.sh@68 -- # keyid=0 00:32:35.443 01:06:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:35.443 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.443 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.443 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.443 01:06:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.443 01:06:42 -- nvmf/common.sh@717 -- # local ip 00:32:35.443 01:06:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.443 01:06:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.443 01:06:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.443 01:06:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.443 01:06:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.443 01:06:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.443 01:06:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.443 01:06:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.443 01:06:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.443 01:06:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:35.443 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.443 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.443 nvme0n1 00:32:35.443 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.443 01:06:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.443 01:06:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.443 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.443 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.443 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.710 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.710 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.710 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.710 01:06:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:32:35.710 01:06:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.710 01:06:42 -- host/auth.sh@44 -- # digest=sha512 00:32:35.710 01:06:42 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:35.710 01:06:42 -- host/auth.sh@44 -- # keyid=1 00:32:35.710 01:06:42 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:35.710 01:06:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.710 01:06:42 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:35.710 01:06:42 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:35.710 01:06:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:32:35.710 01:06:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.710 01:06:42 -- host/auth.sh@68 -- # digest=sha512 00:32:35.710 01:06:42 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:35.710 01:06:42 -- host/auth.sh@68 -- # keyid=1 00:32:35.710 01:06:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:35.710 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.710 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.710 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.710 01:06:42 -- nvmf/common.sh@717 -- # local ip 00:32:35.710 01:06:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.710 01:06:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.710 01:06:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.710 01:06:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.710 01:06:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.710 01:06:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.710 01:06:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.710 01:06:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.710 01:06:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.710 01:06:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:35.710 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.710 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.710 nvme0n1 00:32:35.710 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.710 01:06:42 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.710 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.710 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.710 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.710 01:06:42 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.710 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.710 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.969 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.969 01:06:42 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:35.969 01:06:42 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:32:35.969 01:06:42 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:35.969 01:06:42 -- host/auth.sh@44 -- # digest=sha512 00:32:35.969 01:06:42 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:35.969 01:06:42 -- host/auth.sh@44 -- # keyid=2 00:32:35.969 01:06:42 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:35.969 01:06:42 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:35.969 01:06:42 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:35.969 01:06:42 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:35.969 01:06:42 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:32:35.969 01:06:42 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:35.969 01:06:42 -- host/auth.sh@68 -- # digest=sha512 00:32:35.969 01:06:42 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:35.969 01:06:42 -- host/auth.sh@68 -- # keyid=2 00:32:35.969 01:06:42 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:35.969 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.969 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.969 01:06:42 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.969 01:06:42 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:35.970 01:06:42 -- nvmf/common.sh@717 -- # local ip 00:32:35.970 01:06:42 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:35.970 01:06:42 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:35.970 01:06:42 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:35.970 01:06:42 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:35.970 01:06:42 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:35.970 01:06:42 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:35.970 01:06:42 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:35.970 01:06:42 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:35.970 01:06:42 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:35.970 01:06:42 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:35.970 01:06:42 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.970 01:06:42 -- common/autotest_common.sh@10 -- # set +x 00:32:35.970 nvme0n1 00:32:35.970 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.970 01:06:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:35.970 01:06:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:35.970 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.970 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:35.970 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:35.970 01:06:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:35.970 01:06:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:35.970 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:35.970 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.228 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.228 01:06:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.228 01:06:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:32:36.228 01:06:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.228 01:06:43 -- host/auth.sh@44 -- # digest=sha512 00:32:36.228 01:06:43 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:36.228 01:06:43 -- host/auth.sh@44 -- # keyid=3 00:32:36.228 01:06:43 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:36.228 01:06:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.228 01:06:43 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:36.228 01:06:43 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:36.228 01:06:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:32:36.228 01:06:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.228 01:06:43 -- host/auth.sh@68 -- # digest=sha512 00:32:36.228 01:06:43 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:36.228 01:06:43 -- host/auth.sh@68 -- # keyid=3 00:32:36.228 01:06:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:36.228 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.228 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.228 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.228 01:06:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.228 01:06:43 -- nvmf/common.sh@717 -- # local ip 00:32:36.228 01:06:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.228 01:06:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.228 01:06:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.228 01:06:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.228 01:06:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.228 01:06:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.228 01:06:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.228 01:06:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.228 01:06:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.228 01:06:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:36.228 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.228 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.228 nvme0n1 00:32:36.228 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.229 01:06:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.229 01:06:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.229 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.229 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.229 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.229 01:06:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.229 01:06:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.229 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.229 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.488 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.488 01:06:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.488 01:06:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:32:36.488 01:06:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.488 01:06:43 -- host/auth.sh@44 -- # digest=sha512 00:32:36.489 01:06:43 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:32:36.489 01:06:43 -- host/auth.sh@44 -- # keyid=4 00:32:36.489 01:06:43 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:36.489 01:06:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.489 01:06:43 -- host/auth.sh@48 -- # echo ffdhe3072 00:32:36.489 01:06:43 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:36.489 01:06:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:32:36.489 01:06:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.489 01:06:43 -- host/auth.sh@68 -- # digest=sha512 00:32:36.489 01:06:43 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:32:36.489 01:06:43 -- host/auth.sh@68 -- # keyid=4 00:32:36.489 01:06:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:32:36.489 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.489 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.489 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.489 01:06:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.489 01:06:43 -- nvmf/common.sh@717 -- # local ip 00:32:36.489 01:06:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.489 01:06:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.489 01:06:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.489 01:06:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.489 01:06:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.489 01:06:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.489 01:06:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.489 01:06:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.489 01:06:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.489 01:06:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:36.489 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.489 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.489 nvme0n1 00:32:36.489 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.489 01:06:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:36.489 01:06:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:36.489 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.489 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.489 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.489 01:06:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:36.489 01:06:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:36.489 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.489 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.748 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.748 01:06:43 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:36.748 01:06:43 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:36.748 01:06:43 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:32:36.748 01:06:43 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:36.748 01:06:43 -- host/auth.sh@44 -- # digest=sha512 00:32:36.748 01:06:43 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:36.748 01:06:43 -- host/auth.sh@44 -- # keyid=0 00:32:36.748 01:06:43 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:36.748 01:06:43 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:36.748 01:06:43 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:36.748 01:06:43 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:36.748 01:06:43 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:32:36.748 01:06:43 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:36.748 01:06:43 -- host/auth.sh@68 -- # digest=sha512 00:32:36.748 01:06:43 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:36.748 01:06:43 -- host/auth.sh@68 -- # keyid=0 00:32:36.748 01:06:43 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:36.748 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.748 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:36.748 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:36.748 01:06:43 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:36.748 01:06:43 -- nvmf/common.sh@717 -- # local ip 00:32:36.748 01:06:43 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:36.748 01:06:43 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:36.748 01:06:43 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:36.748 01:06:43 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:36.748 01:06:43 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:36.748 01:06:43 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:36.748 01:06:43 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:36.748 01:06:43 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:36.748 01:06:43 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:36.748 01:06:43 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:36.748 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:36.748 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:37.007 nvme0n1 00:32:37.007 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.007 01:06:43 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.007 01:06:43 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.007 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.007 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:37.007 01:06:43 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.007 01:06:43 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.007 01:06:43 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.007 01:06:43 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.007 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:32:37.007 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.007 01:06:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.007 01:06:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:32:37.007 01:06:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.007 01:06:44 -- host/auth.sh@44 -- # digest=sha512 00:32:37.007 01:06:44 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.007 01:06:44 -- host/auth.sh@44 -- # keyid=1 00:32:37.007 01:06:44 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:37.007 01:06:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.007 01:06:44 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.007 01:06:44 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:37.007 01:06:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:32:37.007 01:06:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.007 01:06:44 -- host/auth.sh@68 -- # digest=sha512 00:32:37.007 01:06:44 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.007 01:06:44 -- host/auth.sh@68 -- # keyid=1 00:32:37.007 01:06:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.007 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.007 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.007 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.007 01:06:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.007 01:06:44 -- nvmf/common.sh@717 -- # local ip 00:32:37.007 01:06:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.007 01:06:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.007 01:06:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.007 01:06:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.007 01:06:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.007 01:06:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.008 01:06:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.008 01:06:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.008 01:06:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.008 01:06:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:37.008 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.008 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.267 nvme0n1 00:32:37.267 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.267 01:06:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.267 01:06:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.267 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.267 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.267 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.267 01:06:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.267 01:06:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.267 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.267 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.267 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.267 01:06:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.267 01:06:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:32:37.267 01:06:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.267 01:06:44 -- host/auth.sh@44 -- # digest=sha512 00:32:37.267 01:06:44 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.267 01:06:44 -- host/auth.sh@44 -- # keyid=2 00:32:37.267 01:06:44 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:37.267 01:06:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.267 01:06:44 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.267 01:06:44 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:37.267 01:06:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:32:37.267 01:06:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.267 01:06:44 -- host/auth.sh@68 -- # digest=sha512 00:32:37.267 01:06:44 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.267 01:06:44 -- host/auth.sh@68 -- # keyid=2 00:32:37.267 01:06:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.267 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.267 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.267 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.267 01:06:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.267 01:06:44 -- nvmf/common.sh@717 -- # local ip 00:32:37.267 01:06:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.267 01:06:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.267 01:06:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.267 01:06:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.267 01:06:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.267 01:06:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.267 01:06:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.267 01:06:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.267 01:06:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.267 01:06:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:37.267 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.267 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.526 nvme0n1 00:32:37.526 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.526 01:06:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.526 01:06:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.526 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.526 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.526 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.526 01:06:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.526 01:06:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.526 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.526 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.526 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.526 01:06:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.526 01:06:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:32:37.526 01:06:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.526 01:06:44 -- host/auth.sh@44 -- # digest=sha512 00:32:37.526 01:06:44 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.526 01:06:44 -- host/auth.sh@44 -- # keyid=3 00:32:37.526 01:06:44 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:37.526 01:06:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.526 01:06:44 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.526 01:06:44 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:37.526 01:06:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:32:37.526 01:06:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.526 01:06:44 -- host/auth.sh@68 -- # digest=sha512 00:32:37.526 01:06:44 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.526 01:06:44 -- host/auth.sh@68 -- # keyid=3 00:32:37.526 01:06:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.526 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.526 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.526 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.526 01:06:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.526 01:06:44 -- nvmf/common.sh@717 -- # local ip 00:32:37.526 01:06:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.526 01:06:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.526 01:06:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.526 01:06:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.526 01:06:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.526 01:06:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.526 01:06:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.526 01:06:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.526 01:06:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.526 01:06:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:37.526 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.526 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.785 nvme0n1 00:32:37.785 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.785 01:06:44 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:37.785 01:06:44 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:37.785 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.785 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.785 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.785 01:06:44 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:37.785 01:06:44 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:37.785 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.785 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.785 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.785 01:06:44 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:37.785 01:06:44 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:32:37.785 01:06:44 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:37.785 01:06:44 -- host/auth.sh@44 -- # digest=sha512 00:32:37.785 01:06:44 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:32:37.785 01:06:44 -- host/auth.sh@44 -- # keyid=4 00:32:37.785 01:06:44 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:37.785 01:06:44 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:37.785 01:06:44 -- host/auth.sh@48 -- # echo ffdhe4096 00:32:37.785 01:06:44 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:37.785 01:06:44 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:32:37.785 01:06:44 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:37.785 01:06:44 -- host/auth.sh@68 -- # digest=sha512 00:32:37.785 01:06:44 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:32:37.785 01:06:44 -- host/auth.sh@68 -- # keyid=4 00:32:37.785 01:06:44 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:32:37.785 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.785 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:37.785 01:06:44 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:37.785 01:06:44 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:37.785 01:06:44 -- nvmf/common.sh@717 -- # local ip 00:32:37.785 01:06:44 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:37.785 01:06:44 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:37.785 01:06:44 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:37.785 01:06:44 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:37.785 01:06:44 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:37.785 01:06:44 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:37.785 01:06:44 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:37.785 01:06:44 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:37.785 01:06:44 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:37.785 01:06:44 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:37.785 01:06:44 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:37.785 01:06:44 -- common/autotest_common.sh@10 -- # set +x 00:32:38.045 nvme0n1 00:32:38.045 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.045 01:06:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:38.045 01:06:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:38.045 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.045 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.045 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.304 01:06:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:38.304 01:06:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:38.304 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.304 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.304 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.304 01:06:45 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:38.304 01:06:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:38.304 01:06:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:32:38.304 01:06:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:38.304 01:06:45 -- host/auth.sh@44 -- # digest=sha512 00:32:38.304 01:06:45 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:38.304 01:06:45 -- host/auth.sh@44 -- # keyid=0 00:32:38.304 01:06:45 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:38.304 01:06:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:38.304 01:06:45 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:38.304 01:06:45 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:38.304 01:06:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:32:38.304 01:06:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:38.304 01:06:45 -- host/auth.sh@68 -- # digest=sha512 00:32:38.304 01:06:45 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:38.304 01:06:45 -- host/auth.sh@68 -- # keyid=0 00:32:38.304 01:06:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:38.304 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.304 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.304 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.304 01:06:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:38.304 01:06:45 -- nvmf/common.sh@717 -- # local ip 00:32:38.304 01:06:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:38.304 01:06:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:38.304 01:06:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:38.304 01:06:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:38.304 01:06:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:38.304 01:06:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:38.304 01:06:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:38.304 01:06:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:38.304 01:06:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:38.304 01:06:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:38.304 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.304 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.563 nvme0n1 00:32:38.563 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.563 01:06:45 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:38.563 01:06:45 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:38.563 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.563 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.563 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.563 01:06:45 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:38.563 01:06:45 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:38.563 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.563 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.563 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.563 01:06:45 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:38.563 01:06:45 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:32:38.563 01:06:45 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:38.563 01:06:45 -- host/auth.sh@44 -- # digest=sha512 00:32:38.563 01:06:45 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:38.563 01:06:45 -- host/auth.sh@44 -- # keyid=1 00:32:38.563 01:06:45 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:38.563 01:06:45 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:38.563 01:06:45 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:38.563 01:06:45 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:38.563 01:06:45 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:32:38.563 01:06:45 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:38.563 01:06:45 -- host/auth.sh@68 -- # digest=sha512 00:32:38.563 01:06:45 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:38.563 01:06:45 -- host/auth.sh@68 -- # keyid=1 00:32:38.563 01:06:45 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:38.563 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.563 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:38.563 01:06:45 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:38.563 01:06:45 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:38.563 01:06:45 -- nvmf/common.sh@717 -- # local ip 00:32:38.563 01:06:45 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:38.563 01:06:45 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:38.563 01:06:45 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:38.563 01:06:45 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:38.563 01:06:45 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:38.563 01:06:45 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:38.563 01:06:45 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:38.563 01:06:45 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:38.563 01:06:45 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:38.563 01:06:45 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:38.563 01:06:45 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:38.563 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:32:39.131 nvme0n1 00:32:39.131 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.131 01:06:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.131 01:06:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.131 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.131 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.131 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.131 01:06:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.131 01:06:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.131 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.131 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.131 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.131 01:06:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:39.131 01:06:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:32:39.131 01:06:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:39.131 01:06:46 -- host/auth.sh@44 -- # digest=sha512 00:32:39.131 01:06:46 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:39.131 01:06:46 -- host/auth.sh@44 -- # keyid=2 00:32:39.131 01:06:46 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:39.131 01:06:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:39.131 01:06:46 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:39.131 01:06:46 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:39.131 01:06:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:32:39.131 01:06:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:39.131 01:06:46 -- host/auth.sh@68 -- # digest=sha512 00:32:39.131 01:06:46 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:39.131 01:06:46 -- host/auth.sh@68 -- # keyid=2 00:32:39.131 01:06:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:39.131 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.131 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.131 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.131 01:06:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:39.131 01:06:46 -- nvmf/common.sh@717 -- # local ip 00:32:39.131 01:06:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:39.131 01:06:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:39.131 01:06:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:39.131 01:06:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:39.131 01:06:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:39.131 01:06:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:39.131 01:06:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:39.131 01:06:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:39.131 01:06:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:39.132 01:06:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:39.132 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.132 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.391 nvme0n1 00:32:39.391 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.391 01:06:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.391 01:06:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.391 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.391 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.391 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.391 01:06:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.391 01:06:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.391 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.391 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.391 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.391 01:06:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:39.391 01:06:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:32:39.391 01:06:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:39.391 01:06:46 -- host/auth.sh@44 -- # digest=sha512 00:32:39.391 01:06:46 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:39.391 01:06:46 -- host/auth.sh@44 -- # keyid=3 00:32:39.391 01:06:46 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:39.391 01:06:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:39.391 01:06:46 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:39.391 01:06:46 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:39.391 01:06:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:32:39.391 01:06:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:39.391 01:06:46 -- host/auth.sh@68 -- # digest=sha512 00:32:39.391 01:06:46 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:39.391 01:06:46 -- host/auth.sh@68 -- # keyid=3 00:32:39.391 01:06:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:39.391 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.391 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.391 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.391 01:06:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:39.391 01:06:46 -- nvmf/common.sh@717 -- # local ip 00:32:39.391 01:06:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:39.391 01:06:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:39.391 01:06:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:39.391 01:06:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:39.391 01:06:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:39.391 01:06:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:39.391 01:06:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:39.391 01:06:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:39.391 01:06:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:39.391 01:06:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:39.391 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.391 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.960 nvme0n1 00:32:39.960 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.960 01:06:46 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:39.960 01:06:46 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:39.960 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.960 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.960 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.960 01:06:46 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:39.960 01:06:46 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:39.960 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.960 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.960 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.960 01:06:46 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:39.960 01:06:46 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:32:39.960 01:06:46 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:39.960 01:06:46 -- host/auth.sh@44 -- # digest=sha512 00:32:39.960 01:06:46 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:32:39.960 01:06:46 -- host/auth.sh@44 -- # keyid=4 00:32:39.960 01:06:46 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:39.960 01:06:46 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:39.960 01:06:46 -- host/auth.sh@48 -- # echo ffdhe6144 00:32:39.961 01:06:46 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:39.961 01:06:46 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:32:39.961 01:06:46 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:39.961 01:06:46 -- host/auth.sh@68 -- # digest=sha512 00:32:39.961 01:06:46 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:32:39.961 01:06:46 -- host/auth.sh@68 -- # keyid=4 00:32:39.961 01:06:46 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:32:39.961 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.961 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:39.961 01:06:46 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:39.961 01:06:46 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:39.961 01:06:46 -- nvmf/common.sh@717 -- # local ip 00:32:39.961 01:06:46 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:39.961 01:06:46 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:39.961 01:06:46 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:39.961 01:06:46 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:39.961 01:06:46 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:39.961 01:06:46 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:39.961 01:06:46 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:39.961 01:06:46 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:39.961 01:06:46 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:39.961 01:06:46 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:39.961 01:06:46 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:39.961 01:06:46 -- common/autotest_common.sh@10 -- # set +x 00:32:40.220 nvme0n1 00:32:40.220 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.220 01:06:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:40.220 01:06:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:40.220 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.220 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.220 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.220 01:06:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:40.220 01:06:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:40.220 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.220 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.220 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.220 01:06:47 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:32:40.220 01:06:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:40.220 01:06:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:32:40.220 01:06:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:40.220 01:06:47 -- host/auth.sh@44 -- # digest=sha512 00:32:40.220 01:06:47 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:40.220 01:06:47 -- host/auth.sh@44 -- # keyid=0 00:32:40.220 01:06:47 -- host/auth.sh@45 -- # key=DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:40.220 01:06:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:40.220 01:06:47 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:40.220 01:06:47 -- host/auth.sh@49 -- # echo DHHC-1:00:NGM3MGViYWRmZTJiNDZjNWZhMjg4ODRiM2NhODdmODnB6oTc: 00:32:40.220 01:06:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:32:40.220 01:06:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:40.220 01:06:47 -- host/auth.sh@68 -- # digest=sha512 00:32:40.220 01:06:47 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:40.220 01:06:47 -- host/auth.sh@68 -- # keyid=0 00:32:40.220 01:06:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:40.220 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.220 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.220 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.220 01:06:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:40.220 01:06:47 -- nvmf/common.sh@717 -- # local ip 00:32:40.220 01:06:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:40.220 01:06:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:40.220 01:06:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:40.220 01:06:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:40.220 01:06:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:40.220 01:06:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:40.220 01:06:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:40.220 01:06:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:40.220 01:06:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:40.221 01:06:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:32:40.221 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.221 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.789 nvme0n1 00:32:40.789 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.789 01:06:47 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:40.790 01:06:47 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:40.790 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.790 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.790 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.790 01:06:47 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:40.790 01:06:47 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:40.790 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.790 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.790 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.790 01:06:47 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:40.790 01:06:47 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:32:40.790 01:06:47 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:40.790 01:06:47 -- host/auth.sh@44 -- # digest=sha512 00:32:40.790 01:06:47 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:40.790 01:06:47 -- host/auth.sh@44 -- # keyid=1 00:32:40.790 01:06:47 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:40.790 01:06:47 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:40.790 01:06:47 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:40.790 01:06:47 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:40.790 01:06:47 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:32:40.790 01:06:47 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:40.790 01:06:47 -- host/auth.sh@68 -- # digest=sha512 00:32:40.790 01:06:47 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:40.790 01:06:47 -- host/auth.sh@68 -- # keyid=1 00:32:40.790 01:06:47 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:40.790 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.790 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:40.790 01:06:47 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:40.790 01:06:47 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:40.790 01:06:47 -- nvmf/common.sh@717 -- # local ip 00:32:40.790 01:06:47 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:40.790 01:06:47 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:40.790 01:06:47 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:40.790 01:06:47 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:40.790 01:06:47 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:40.790 01:06:47 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:40.790 01:06:47 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:40.790 01:06:47 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:40.790 01:06:47 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:40.790 01:06:47 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:32:40.790 01:06:47 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:40.790 01:06:47 -- common/autotest_common.sh@10 -- # set +x 00:32:41.359 nvme0n1 00:32:41.359 01:06:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.359 01:06:48 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:41.359 01:06:48 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:41.359 01:06:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.359 01:06:48 -- common/autotest_common.sh@10 -- # set +x 00:32:41.359 01:06:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.359 01:06:48 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:41.359 01:06:48 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:41.359 01:06:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.359 01:06:48 -- common/autotest_common.sh@10 -- # set +x 00:32:41.359 01:06:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.359 01:06:48 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:41.359 01:06:48 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:32:41.359 01:06:48 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:41.359 01:06:48 -- host/auth.sh@44 -- # digest=sha512 00:32:41.359 01:06:48 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:41.359 01:06:48 -- host/auth.sh@44 -- # keyid=2 00:32:41.359 01:06:48 -- host/auth.sh@45 -- # key=DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:41.359 01:06:48 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:41.359 01:06:48 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:41.359 01:06:48 -- host/auth.sh@49 -- # echo DHHC-1:01:YWQ3Nzc5NjMyYjM0OGU1MzMzZTRjNGE1NGRiOGE5NGIr+yRU: 00:32:41.359 01:06:48 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:32:41.359 01:06:48 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:41.359 01:06:48 -- host/auth.sh@68 -- # digest=sha512 00:32:41.359 01:06:48 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:41.359 01:06:48 -- host/auth.sh@68 -- # keyid=2 00:32:41.359 01:06:48 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:41.359 01:06:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.359 01:06:48 -- common/autotest_common.sh@10 -- # set +x 00:32:41.359 01:06:48 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.359 01:06:48 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:41.359 01:06:48 -- nvmf/common.sh@717 -- # local ip 00:32:41.359 01:06:48 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:41.359 01:06:48 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:41.359 01:06:48 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:41.359 01:06:48 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:41.359 01:06:48 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:41.359 01:06:48 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:41.359 01:06:48 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:41.359 01:06:48 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:41.359 01:06:48 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:41.359 01:06:48 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:41.359 01:06:48 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.359 01:06:48 -- common/autotest_common.sh@10 -- # set +x 00:32:41.928 nvme0n1 00:32:41.928 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.928 01:06:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:41.928 01:06:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:41.928 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.928 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:41.928 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.928 01:06:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:41.928 01:06:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:41.928 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.928 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:41.928 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.928 01:06:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:41.928 01:06:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:32:41.928 01:06:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:41.928 01:06:49 -- host/auth.sh@44 -- # digest=sha512 00:32:41.928 01:06:49 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:41.928 01:06:49 -- host/auth.sh@44 -- # keyid=3 00:32:41.928 01:06:49 -- host/auth.sh@45 -- # key=DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:41.928 01:06:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:41.928 01:06:49 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:41.928 01:06:49 -- host/auth.sh@49 -- # echo DHHC-1:02:OTRlOTVmYmMyZTA2YjkyY2FmYzJjOGZhOTBhN2NhMmEwNmMxM2RlODY5MmRiNjliraGWbg==: 00:32:41.928 01:06:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:32:41.928 01:06:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:41.928 01:06:49 -- host/auth.sh@68 -- # digest=sha512 00:32:41.928 01:06:49 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:41.928 01:06:49 -- host/auth.sh@68 -- # keyid=3 00:32:41.928 01:06:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:41.928 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:41.928 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:41.928 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:41.928 01:06:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:41.928 01:06:49 -- nvmf/common.sh@717 -- # local ip 00:32:41.928 01:06:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:41.928 01:06:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:41.928 01:06:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:41.928 01:06:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:41.928 01:06:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:41.928 01:06:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:42.187 01:06:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:42.187 01:06:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:42.187 01:06:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:42.187 01:06:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:32:42.187 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.187 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:42.756 nvme0n1 00:32:42.756 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.756 01:06:49 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:42.756 01:06:49 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:42.756 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.756 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:42.757 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.757 01:06:49 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:42.757 01:06:49 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:42.757 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.757 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:42.757 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.757 01:06:49 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:32:42.757 01:06:49 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:32:42.757 01:06:49 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:42.757 01:06:49 -- host/auth.sh@44 -- # digest=sha512 00:32:42.757 01:06:49 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:32:42.757 01:06:49 -- host/auth.sh@44 -- # keyid=4 00:32:42.757 01:06:49 -- host/auth.sh@45 -- # key=DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:42.757 01:06:49 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:32:42.757 01:06:49 -- host/auth.sh@48 -- # echo ffdhe8192 00:32:42.757 01:06:49 -- host/auth.sh@49 -- # echo DHHC-1:03:OGM1ZDFhNGZiYTdjN2U4MTU4Y2VkZmY4M2UzMmJkOWYyNGUyN2M2MjJmOTkwYmQyMDk4Yzk1NWNmM2VmODYzZrzuf+8=: 00:32:42.757 01:06:49 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:32:42.757 01:06:49 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:32:42.757 01:06:49 -- host/auth.sh@68 -- # digest=sha512 00:32:42.757 01:06:49 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:32:42.757 01:06:49 -- host/auth.sh@68 -- # keyid=4 00:32:42.757 01:06:49 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:32:42.757 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.757 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:42.757 01:06:49 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:42.757 01:06:49 -- host/auth.sh@70 -- # get_main_ns_ip 00:32:42.757 01:06:49 -- nvmf/common.sh@717 -- # local ip 00:32:42.757 01:06:49 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:42.757 01:06:49 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:42.757 01:06:49 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:42.757 01:06:49 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:42.757 01:06:49 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:42.757 01:06:49 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:42.757 01:06:49 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:42.757 01:06:49 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:42.757 01:06:49 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:42.757 01:06:49 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:32:42.757 01:06:49 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:42.757 01:06:49 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 nvme0n1 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:32:43.326 01:06:50 -- host/auth.sh@73 -- # jq -r '.[].name' 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:32:43.326 01:06:50 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:32:43.326 01:06:50 -- host/auth.sh@44 -- # digest=sha256 00:32:43.326 01:06:50 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:32:43.326 01:06:50 -- host/auth.sh@44 -- # keyid=1 00:32:43.326 01:06:50 -- host/auth.sh@45 -- # key=DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:43.326 01:06:50 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:32:43.326 01:06:50 -- host/auth.sh@48 -- # echo ffdhe2048 00:32:43.326 01:06:50 -- host/auth.sh@49 -- # echo DHHC-1:00:NDhiYWIwZGQ4M2M5ZTRjMjVkNGY5OTJiNjU5MTA3NzRkMjYzZTIyYmRiM2NiZDIwI9YuqQ==: 00:32:43.326 01:06:50 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@119 -- # get_main_ns_ip 00:32:43.326 01:06:50 -- nvmf/common.sh@717 -- # local ip 00:32:43.326 01:06:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:43.326 01:06:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:43.326 01:06:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:43.326 01:06:50 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:43.326 01:06:50 -- common/autotest_common.sh@638 -- # local es=0 00:32:43.326 01:06:50 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:43.326 01:06:50 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:43.326 01:06:50 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 request: 00:32:43.326 { 00:32:43.326 "name": "nvme0", 00:32:43.326 "trtype": "rdma", 00:32:43.326 "traddr": "192.168.100.8", 00:32:43.326 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:43.326 "adrfam": "ipv4", 00:32:43.326 "trsvcid": "4420", 00:32:43.326 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:43.326 "method": "bdev_nvme_attach_controller", 00:32:43.326 "req_id": 1 00:32:43.326 } 00:32:43.326 Got JSON-RPC error response 00:32:43.326 response: 00:32:43.326 { 00:32:43.326 "code": -32602, 00:32:43.326 "message": "Invalid parameters" 00:32:43.326 } 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:43.326 01:06:50 -- common/autotest_common.sh@641 -- # es=1 00:32:43.326 01:06:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:43.326 01:06:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:43.326 01:06:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:43.326 01:06:50 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:32:43.326 01:06:50 -- host/auth.sh@121 -- # jq length 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.326 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.326 01:06:50 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:32:43.326 01:06:50 -- host/auth.sh@124 -- # get_main_ns_ip 00:32:43.326 01:06:50 -- nvmf/common.sh@717 -- # local ip 00:32:43.326 01:06:50 -- nvmf/common.sh@718 -- # ip_candidates=() 00:32:43.326 01:06:50 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:32:43.326 01:06:50 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:32:43.326 01:06:50 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:32:43.326 01:06:50 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:32:43.326 01:06:50 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:43.326 01:06:50 -- common/autotest_common.sh@638 -- # local es=0 00:32:43.326 01:06:50 -- common/autotest_common.sh@640 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:43.326 01:06:50 -- common/autotest_common.sh@626 -- # local arg=rpc_cmd 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # type -t rpc_cmd 00:32:43.326 01:06:50 -- common/autotest_common.sh@630 -- # case "$(type -t "$arg")" in 00:32:43.326 01:06:50 -- common/autotest_common.sh@641 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:32:43.326 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.326 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.587 request: 00:32:43.587 { 00:32:43.587 "name": "nvme0", 00:32:43.587 "trtype": "rdma", 00:32:43.587 "traddr": "192.168.100.8", 00:32:43.587 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:32:43.587 "adrfam": "ipv4", 00:32:43.587 "trsvcid": "4420", 00:32:43.587 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:32:43.587 "dhchap_key": "key2", 00:32:43.587 "method": "bdev_nvme_attach_controller", 00:32:43.587 "req_id": 1 00:32:43.587 } 00:32:43.587 Got JSON-RPC error response 00:32:43.587 response: 00:32:43.587 { 00:32:43.587 "code": -32602, 00:32:43.587 "message": "Invalid parameters" 00:32:43.587 } 00:32:43.587 01:06:50 -- common/autotest_common.sh@577 -- # [[ 1 == 0 ]] 00:32:43.587 01:06:50 -- common/autotest_common.sh@641 -- # es=1 00:32:43.587 01:06:50 -- common/autotest_common.sh@649 -- # (( es > 128 )) 00:32:43.587 01:06:50 -- common/autotest_common.sh@660 -- # [[ -n '' ]] 00:32:43.587 01:06:50 -- common/autotest_common.sh@665 -- # (( !es == 0 )) 00:32:43.587 01:06:50 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:32:43.587 01:06:50 -- host/auth.sh@127 -- # jq length 00:32:43.587 01:06:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:32:43.587 01:06:50 -- common/autotest_common.sh@10 -- # set +x 00:32:43.587 01:06:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:32:43.587 01:06:50 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:32:43.587 01:06:50 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:32:43.587 01:06:50 -- host/auth.sh@130 -- # cleanup 00:32:43.587 01:06:50 -- host/auth.sh@24 -- # nvmftestfini 00:32:43.587 01:06:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:32:43.587 01:06:50 -- nvmf/common.sh@117 -- # sync 00:32:43.587 01:06:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:32:43.587 01:06:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:32:43.587 01:06:50 -- nvmf/common.sh@120 -- # set +e 00:32:43.587 01:06:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:32:43.587 01:06:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:32:43.587 rmmod nvme_rdma 00:32:43.587 rmmod nvme_fabrics 00:32:43.587 01:06:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:32:43.587 01:06:50 -- nvmf/common.sh@124 -- # set -e 00:32:43.587 01:06:50 -- nvmf/common.sh@125 -- # return 0 00:32:43.587 01:06:50 -- nvmf/common.sh@478 -- # '[' -n 514849 ']' 00:32:43.587 01:06:50 -- nvmf/common.sh@479 -- # killprocess 514849 00:32:43.587 01:06:50 -- common/autotest_common.sh@936 -- # '[' -z 514849 ']' 00:32:43.587 01:06:50 -- common/autotest_common.sh@940 -- # kill -0 514849 00:32:43.587 01:06:50 -- common/autotest_common.sh@941 -- # uname 00:32:43.587 01:06:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:43.587 01:06:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 514849 00:32:43.587 01:06:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:43.587 01:06:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:43.587 01:06:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 514849' 00:32:43.587 killing process with pid 514849 00:32:43.587 01:06:50 -- common/autotest_common.sh@955 -- # kill 514849 00:32:43.587 01:06:50 -- common/autotest_common.sh@960 -- # wait 514849 00:32:43.847 01:06:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:32:43.847 01:06:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:32:43.847 01:06:50 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:32:43.847 01:06:50 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:32:43.847 01:06:50 -- host/auth.sh@27 -- # clean_kernel_target 00:32:43.847 01:06:50 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:32:43.847 01:06:50 -- nvmf/common.sh@675 -- # echo 0 00:32:43.847 01:06:50 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:43.847 01:06:50 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:32:43.847 01:06:50 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:43.847 01:06:50 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:32:43.847 01:06:50 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:32:43.848 01:06:50 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:32:43.848 01:06:50 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:32:46.386 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:46.386 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:46.645 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:46.646 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:49.940 0000:d8:00.0 (8086 0a54): nvme -> vfio-pci 00:32:51.346 01:06:58 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.zVl /tmp/spdk.key-null.fjp /tmp/spdk.key-sha256.dl9 /tmp/spdk.key-sha384.qeF /tmp/spdk.key-sha512.lTV /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:32:51.346 01:06:58 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:32:53.885 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:32:53.885 0000:d8:00.0 (8086 0a54): Already using the vfio-pci driver 00:32:54.821 00:32:54.821 real 0m55.798s 00:32:54.821 user 0m43.742s 00:32:54.821 sys 0m13.359s 00:32:54.821 01:07:01 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:32:54.821 01:07:01 -- common/autotest_common.sh@10 -- # set +x 00:32:54.821 ************************************ 00:32:54.821 END TEST nvmf_auth 00:32:54.821 ************************************ 00:32:54.821 01:07:01 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:32:54.821 01:07:01 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:32:54.821 01:07:01 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:32:54.821 01:07:01 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:32:54.821 01:07:01 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:54.821 01:07:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:32:54.821 01:07:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:54.821 01:07:01 -- common/autotest_common.sh@10 -- # set +x 00:32:54.821 ************************************ 00:32:54.821 START TEST nvmf_bdevperf 00:32:54.821 ************************************ 00:32:54.821 01:07:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:32:55.081 * Looking for test storage... 00:32:55.081 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:32:55.081 01:07:02 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:32:55.081 01:07:02 -- nvmf/common.sh@7 -- # uname -s 00:32:55.081 01:07:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:55.081 01:07:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:55.081 01:07:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:55.081 01:07:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:55.081 01:07:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:55.081 01:07:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:55.081 01:07:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:55.081 01:07:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:55.081 01:07:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:55.081 01:07:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:55.081 01:07:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:32:55.081 01:07:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:32:55.081 01:07:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:55.081 01:07:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:55.081 01:07:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:55.081 01:07:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:32:55.081 01:07:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:32:55.081 01:07:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:55.081 01:07:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:55.081 01:07:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:55.081 01:07:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.081 01:07:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.081 01:07:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.081 01:07:02 -- paths/export.sh@5 -- # export PATH 00:32:55.081 01:07:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:55.081 01:07:02 -- nvmf/common.sh@47 -- # : 0 00:32:55.081 01:07:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:32:55.081 01:07:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:32:55.081 01:07:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:32:55.081 01:07:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:55.081 01:07:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:55.081 01:07:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:32:55.081 01:07:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:32:55.081 01:07:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:32:55.081 01:07:02 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:32:55.081 01:07:02 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:32:55.081 01:07:02 -- host/bdevperf.sh@24 -- # nvmftestinit 00:32:55.081 01:07:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:32:55.081 01:07:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:55.081 01:07:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:32:55.081 01:07:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:32:55.081 01:07:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:32:55.081 01:07:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:55.081 01:07:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:32:55.081 01:07:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:55.081 01:07:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:32:55.081 01:07:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:32:55.081 01:07:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:32:55.081 01:07:02 -- common/autotest_common.sh@10 -- # set +x 00:33:00.360 01:07:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:00.360 01:07:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:00.360 01:07:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:00.360 01:07:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:00.360 01:07:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:00.360 01:07:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:00.360 01:07:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:00.360 01:07:06 -- nvmf/common.sh@295 -- # net_devs=() 00:33:00.360 01:07:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:00.360 01:07:06 -- nvmf/common.sh@296 -- # e810=() 00:33:00.360 01:07:06 -- nvmf/common.sh@296 -- # local -ga e810 00:33:00.360 01:07:06 -- nvmf/common.sh@297 -- # x722=() 00:33:00.360 01:07:06 -- nvmf/common.sh@297 -- # local -ga x722 00:33:00.360 01:07:06 -- nvmf/common.sh@298 -- # mlx=() 00:33:00.360 01:07:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:00.360 01:07:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:00.360 01:07:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:00.360 01:07:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:00.360 01:07:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:33:00.360 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:33:00.360 01:07:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:00.360 01:07:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:00.360 01:07:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:33:00.360 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:33:00.360 01:07:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:00.360 01:07:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:00.360 01:07:06 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:00.360 01:07:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:00.360 01:07:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:00.360 01:07:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:00.360 01:07:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:33:00.360 Found net devices under 0000:18:00.0: mlx_0_0 00:33:00.360 01:07:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:00.360 01:07:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:00.360 01:07:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:00.360 01:07:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:00.360 01:07:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:33:00.360 Found net devices under 0000:18:00.1: mlx_0_1 00:33:00.360 01:07:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:00.360 01:07:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:00.360 01:07:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:00.360 01:07:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:00.360 01:07:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:00.360 01:07:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:00.360 01:07:06 -- nvmf/common.sh@58 -- # uname 00:33:00.360 01:07:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:00.360 01:07:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:00.360 01:07:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:00.360 01:07:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:00.360 01:07:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:00.360 01:07:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:00.360 01:07:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:00.360 01:07:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:00.360 01:07:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:00.360 01:07:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:00.360 01:07:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:00.360 01:07:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:00.360 01:07:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:00.360 01:07:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:00.360 01:07:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:00.360 01:07:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:00.360 01:07:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.360 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.360 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:00.360 01:07:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:00.360 01:07:07 -- nvmf/common.sh@105 -- # continue 2 00:33:00.360 01:07:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.360 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.360 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:00.360 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.360 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:00.360 01:07:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:00.360 01:07:07 -- nvmf/common.sh@105 -- # continue 2 00:33:00.360 01:07:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:00.361 01:07:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.361 01:07:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:00.361 01:07:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:33:00.361 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:00.361 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:33:00.361 altname enp24s0f0np0 00:33:00.361 altname ens785f0np0 00:33:00.361 inet 192.168.100.8/24 scope global mlx_0_0 00:33:00.361 valid_lft forever preferred_lft forever 00:33:00.361 01:07:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:00.361 01:07:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.361 01:07:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:00.361 01:07:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:33:00.361 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:00.361 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:33:00.361 altname enp24s0f1np1 00:33:00.361 altname ens785f1np1 00:33:00.361 inet 192.168.100.9/24 scope global mlx_0_1 00:33:00.361 valid_lft forever preferred_lft forever 00:33:00.361 01:07:07 -- nvmf/common.sh@411 -- # return 0 00:33:00.361 01:07:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:00.361 01:07:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:00.361 01:07:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:00.361 01:07:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:00.361 01:07:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:00.361 01:07:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:00.361 01:07:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:00.361 01:07:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:00.361 01:07:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:00.361 01:07:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.361 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.361 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@105 -- # continue 2 00:33:00.361 01:07:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:00.361 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.361 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:00.361 01:07:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:00.361 01:07:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@105 -- # continue 2 00:33:00.361 01:07:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:00.361 01:07:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.361 01:07:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:00.361 01:07:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:00.361 01:07:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:00.361 01:07:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:00.361 192.168.100.9' 00:33:00.361 01:07:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:00.361 192.168.100.9' 00:33:00.361 01:07:07 -- nvmf/common.sh@446 -- # head -n 1 00:33:00.361 01:07:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:00.361 01:07:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:00.361 192.168.100.9' 00:33:00.361 01:07:07 -- nvmf/common.sh@447 -- # tail -n +2 00:33:00.361 01:07:07 -- nvmf/common.sh@447 -- # head -n 1 00:33:00.361 01:07:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:00.361 01:07:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:00.361 01:07:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:00.361 01:07:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:00.361 01:07:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:00.361 01:07:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:00.361 01:07:07 -- host/bdevperf.sh@25 -- # tgt_init 00:33:00.361 01:07:07 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:33:00.361 01:07:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:00.361 01:07:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:00.361 01:07:07 -- common/autotest_common.sh@10 -- # set +x 00:33:00.361 01:07:07 -- nvmf/common.sh@470 -- # nvmfpid=529457 00:33:00.361 01:07:07 -- nvmf/common.sh@471 -- # waitforlisten 529457 00:33:00.361 01:07:07 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:33:00.361 01:07:07 -- common/autotest_common.sh@817 -- # '[' -z 529457 ']' 00:33:00.361 01:07:07 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:00.361 01:07:07 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:00.361 01:07:07 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:00.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:00.361 01:07:07 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:00.361 01:07:07 -- common/autotest_common.sh@10 -- # set +x 00:33:00.361 [2024-04-26 01:07:07.220569] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:00.361 [2024-04-26 01:07:07.220612] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:00.361 EAL: No free 2048 kB hugepages reported on node 1 00:33:00.361 [2024-04-26 01:07:07.269646] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:33:00.361 [2024-04-26 01:07:07.340511] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:00.361 [2024-04-26 01:07:07.340544] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:00.361 [2024-04-26 01:07:07.340550] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:00.361 [2024-04-26 01:07:07.340556] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:00.361 [2024-04-26 01:07:07.340561] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:00.361 [2024-04-26 01:07:07.340671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:00.361 [2024-04-26 01:07:07.340767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:00.361 [2024-04-26 01:07:07.340768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:00.930 01:07:07 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:00.930 01:07:07 -- common/autotest_common.sh@850 -- # return 0 00:33:00.930 01:07:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:00.930 01:07:07 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:00.930 01:07:07 -- common/autotest_common.sh@10 -- # set +x 00:33:00.930 01:07:08 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:00.930 01:07:08 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:33:00.930 01:07:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:00.930 01:07:08 -- common/autotest_common.sh@10 -- # set +x 00:33:00.930 [2024-04-26 01:07:08.054021] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xa45080/0xa49570) succeed. 00:33:00.930 [2024-04-26 01:07:08.064226] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xa46620/0xa8ac00) succeed. 00:33:01.194 01:07:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:01.194 01:07:08 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:01.194 01:07:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:01.194 01:07:08 -- common/autotest_common.sh@10 -- # set +x 00:33:01.194 Malloc0 00:33:01.194 01:07:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:01.194 01:07:08 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:01.194 01:07:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:01.194 01:07:08 -- common/autotest_common.sh@10 -- # set +x 00:33:01.194 01:07:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:01.194 01:07:08 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:01.194 01:07:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:01.194 01:07:08 -- common/autotest_common.sh@10 -- # set +x 00:33:01.194 01:07:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:01.194 01:07:08 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:01.194 01:07:08 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:01.194 01:07:08 -- common/autotest_common.sh@10 -- # set +x 00:33:01.194 [2024-04-26 01:07:08.203496] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:01.194 01:07:08 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:01.194 01:07:08 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:33:01.194 01:07:08 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:33:01.194 01:07:08 -- nvmf/common.sh@521 -- # config=() 00:33:01.194 01:07:08 -- nvmf/common.sh@521 -- # local subsystem config 00:33:01.194 01:07:08 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:33:01.194 01:07:08 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:33:01.194 { 00:33:01.194 "params": { 00:33:01.194 "name": "Nvme$subsystem", 00:33:01.194 "trtype": "$TEST_TRANSPORT", 00:33:01.194 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:01.194 "adrfam": "ipv4", 00:33:01.194 "trsvcid": "$NVMF_PORT", 00:33:01.194 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:01.194 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:01.194 "hdgst": ${hdgst:-false}, 00:33:01.194 "ddgst": ${ddgst:-false} 00:33:01.194 }, 00:33:01.194 "method": "bdev_nvme_attach_controller" 00:33:01.194 } 00:33:01.194 EOF 00:33:01.194 )") 00:33:01.194 01:07:08 -- nvmf/common.sh@543 -- # cat 00:33:01.194 01:07:08 -- nvmf/common.sh@545 -- # jq . 00:33:01.194 01:07:08 -- nvmf/common.sh@546 -- # IFS=, 00:33:01.194 01:07:08 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:33:01.194 "params": { 00:33:01.194 "name": "Nvme1", 00:33:01.194 "trtype": "rdma", 00:33:01.194 "traddr": "192.168.100.8", 00:33:01.194 "adrfam": "ipv4", 00:33:01.194 "trsvcid": "4420", 00:33:01.194 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:01.194 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:01.194 "hdgst": false, 00:33:01.194 "ddgst": false 00:33:01.194 }, 00:33:01.194 "method": "bdev_nvme_attach_controller" 00:33:01.194 }' 00:33:01.194 [2024-04-26 01:07:08.250251] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:01.194 [2024-04-26 01:07:08.250295] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid529734 ] 00:33:01.194 EAL: No free 2048 kB hugepages reported on node 1 00:33:01.194 [2024-04-26 01:07:08.299875] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:33:01.194 [2024-04-26 01:07:08.365583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:01.453 Running I/O for 1 seconds... 00:33:02.389 00:33:02.389 Latency(us) 00:33:02.389 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:33:02.389 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:33:02.389 Verification LBA range: start 0x0 length 0x4000 00:33:02.389 Nvme1n1 : 1.00 19747.05 77.14 0.00 0.00 6447.96 2330.17 11650.84 00:33:02.389 =================================================================================================================== 00:33:02.389 Total : 19747.05 77.14 0.00 0.00 6447.96 2330.17 11650.84 00:33:02.648 01:07:09 -- host/bdevperf.sh@30 -- # bdevperfpid=529998 00:33:02.648 01:07:09 -- host/bdevperf.sh@32 -- # sleep 3 00:33:02.648 01:07:09 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:33:02.648 01:07:09 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:33:02.648 01:07:09 -- nvmf/common.sh@521 -- # config=() 00:33:02.648 01:07:09 -- nvmf/common.sh@521 -- # local subsystem config 00:33:02.648 01:07:09 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:33:02.648 01:07:09 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:33:02.648 { 00:33:02.648 "params": { 00:33:02.648 "name": "Nvme$subsystem", 00:33:02.648 "trtype": "$TEST_TRANSPORT", 00:33:02.648 "traddr": "$NVMF_FIRST_TARGET_IP", 00:33:02.648 "adrfam": "ipv4", 00:33:02.648 "trsvcid": "$NVMF_PORT", 00:33:02.648 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:33:02.648 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:33:02.648 "hdgst": ${hdgst:-false}, 00:33:02.648 "ddgst": ${ddgst:-false} 00:33:02.648 }, 00:33:02.648 "method": "bdev_nvme_attach_controller" 00:33:02.648 } 00:33:02.648 EOF 00:33:02.648 )") 00:33:02.648 01:07:09 -- nvmf/common.sh@543 -- # cat 00:33:02.648 01:07:09 -- nvmf/common.sh@545 -- # jq . 00:33:02.648 01:07:09 -- nvmf/common.sh@546 -- # IFS=, 00:33:02.648 01:07:09 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:33:02.648 "params": { 00:33:02.648 "name": "Nvme1", 00:33:02.648 "trtype": "rdma", 00:33:02.648 "traddr": "192.168.100.8", 00:33:02.648 "adrfam": "ipv4", 00:33:02.648 "trsvcid": "4420", 00:33:02.648 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:33:02.648 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:33:02.648 "hdgst": false, 00:33:02.648 "ddgst": false 00:33:02.649 }, 00:33:02.649 "method": "bdev_nvme_attach_controller" 00:33:02.649 }' 00:33:02.649 [2024-04-26 01:07:09.807411] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:02.649 [2024-04-26 01:07:09.807456] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid529998 ] 00:33:02.649 EAL: No free 2048 kB hugepages reported on node 1 00:33:02.908 [2024-04-26 01:07:09.857726] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:33:02.908 [2024-04-26 01:07:09.918707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:02.908 Running I/O for 15 seconds... 00:33:06.196 01:07:12 -- host/bdevperf.sh@33 -- # kill -9 529457 00:33:06.196 01:07:12 -- host/bdevperf.sh@35 -- # sleep 3 00:33:06.766 [2024-04-26 01:07:13.796977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:30728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:30736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:30744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:30752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:30760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:30768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:30776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:30784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:30792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:30800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:30808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:30816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:30832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:30840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.766 [2024-04-26 01:07:13.797219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.766 [2024-04-26 01:07:13.797226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:30856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:30864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:30872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:30880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:30888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:30896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:30904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:30912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:30920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:30944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:30952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:30968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:30976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:30984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:30992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:31000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:31008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:31016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:31032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:31040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:31048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:31056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:31064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:31072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:31088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:31096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.767 [2024-04-26 01:07:13.797729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.767 [2024-04-26 01:07:13.797736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:31104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:31112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:31120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:31128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:31136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:31144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:31160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:31168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:31176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:31184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:31192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:31200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:31208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:31216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:31224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:31232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:31240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:31248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:31256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.797990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.797997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:31272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:31280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:31288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:31304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:31312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:31320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:31328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:31336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:31344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:31352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:31360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.768 [2024-04-26 01:07:13.798156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:31368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.768 [2024-04-26 01:07:13.798161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:31384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:31392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:31400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:31408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:31416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:31424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:31432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:31440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:31448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:31456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:31464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:31472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:31480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:31488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:31496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:31504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:31520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:31536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:31552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:31560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:31576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:31584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:31592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:31600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:31608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.769 [2024-04-26 01:07:13.798551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:31616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.769 [2024-04-26 01:07:13.798556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:31624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:31632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:31640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:31648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:31656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:31664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:31672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:31680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:31688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:31696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:31712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:31728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.798744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:33:06.770 [2024-04-26 01:07:13.798749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.800595] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:33:06.770 [2024-04-26 01:07:13.800606] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:33:06.770 [2024-04-26 01:07:13.800614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:30720 len:8 PRP1 0x0 PRP2 0x0 00:33:06.770 [2024-04-26 01:07:13.800620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:33:06.770 [2024-04-26 01:07:13.800657] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:33:06.770 [2024-04-26 01:07:13.803142] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:06.770 [2024-04-26 01:07:13.816363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:06.770 [2024-04-26 01:07:13.819635] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:06.770 [2024-04-26 01:07:13.819653] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:06.770 [2024-04-26 01:07:13.819659] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:07.709 [2024-04-26 01:07:14.823528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:07.709 [2024-04-26 01:07:14.823578] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:07.709 [2024-04-26 01:07:14.823865] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:07.709 [2024-04-26 01:07:14.823874] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:07.709 [2024-04-26 01:07:14.823883] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:07.709 [2024-04-26 01:07:14.826126] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:33:07.709 [2024-04-26 01:07:14.827336] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:07.709 [2024-04-26 01:07:14.838674] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:07.709 [2024-04-26 01:07:14.841082] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:07.709 [2024-04-26 01:07:14.841097] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:07.709 [2024-04-26 01:07:14.841103] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:08.649 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 529457 Killed "${NVMF_APP[@]}" "$@" 00:33:08.649 01:07:15 -- host/bdevperf.sh@36 -- # tgt_init 00:33:08.649 01:07:15 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:33:08.649 01:07:15 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:08.649 01:07:15 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:08.650 01:07:15 -- common/autotest_common.sh@10 -- # set +x 00:33:08.650 01:07:15 -- nvmf/common.sh@470 -- # nvmfpid=531051 00:33:08.650 01:07:15 -- nvmf/common.sh@471 -- # waitforlisten 531051 00:33:08.650 01:07:15 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:33:08.650 01:07:15 -- common/autotest_common.sh@817 -- # '[' -z 531051 ']' 00:33:08.650 01:07:15 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:08.650 01:07:15 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:08.650 01:07:15 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:08.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:08.650 01:07:15 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:08.650 01:07:15 -- common/autotest_common.sh@10 -- # set +x 00:33:08.650 [2024-04-26 01:07:15.823914] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:08.650 [2024-04-26 01:07:15.823952] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:08.909 [2024-04-26 01:07:15.844771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:08.909 [2024-04-26 01:07:15.844788] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:08.909 [2024-04-26 01:07:15.844947] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:08.909 [2024-04-26 01:07:15.844954] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:08.909 [2024-04-26 01:07:15.844961] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:08.909 EAL: No free 2048 kB hugepages reported on node 1 00:33:08.909 [2024-04-26 01:07:15.847457] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:08.909 [2024-04-26 01:07:15.851007] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:08.910 [2024-04-26 01:07:15.853260] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:08.910 [2024-04-26 01:07:15.853277] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:08.910 [2024-04-26 01:07:15.853283] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:33:08.910 [2024-04-26 01:07:15.875207] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:33:08.910 [2024-04-26 01:07:15.942381] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:08.910 [2024-04-26 01:07:15.942409] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:08.910 [2024-04-26 01:07:15.942415] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:08.910 [2024-04-26 01:07:15.942421] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:08.910 [2024-04-26 01:07:15.942425] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:08.910 [2024-04-26 01:07:15.942463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:33:08.910 [2024-04-26 01:07:15.942543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:33:08.910 [2024-04-26 01:07:15.942544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:09.479 01:07:16 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:09.479 01:07:16 -- common/autotest_common.sh@850 -- # return 0 00:33:09.479 01:07:16 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:09.479 01:07:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:09.479 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.479 01:07:16 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:09.479 01:07:16 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:33:09.479 01:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:09.480 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.480 [2024-04-26 01:07:16.657956] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xe5f080/0xe63570) succeed. 00:33:09.480 [2024-04-26 01:07:16.666987] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xe60620/0xea4c00) succeed. 00:33:09.740 01:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:09.740 01:07:16 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:09.740 01:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:09.740 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.740 Malloc0 00:33:09.740 01:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:09.740 01:07:16 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:09.740 01:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:09.740 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.740 01:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:09.740 01:07:16 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:09.740 01:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:09.740 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.740 01:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:09.740 01:07:16 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:09.740 01:07:16 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:09.740 01:07:16 -- common/autotest_common.sh@10 -- # set +x 00:33:09.740 [2024-04-26 01:07:16.806499] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:09.740 01:07:16 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:09.740 01:07:16 -- host/bdevperf.sh@38 -- # wait 529998 00:33:09.740 [2024-04-26 01:07:16.857062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:09.740 [2024-04-26 01:07:16.857086] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:09.740 [2024-04-26 01:07:16.857250] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:33:09.740 [2024-04-26 01:07:16.857257] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:33:09.740 [2024-04-26 01:07:16.857264] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:33:09.740 [2024-04-26 01:07:16.859773] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:33:09.740 [2024-04-26 01:07:16.865401] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:33:09.740 [2024-04-26 01:07:16.913207] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:33:19.730 00:33:19.730 Latency(us) 00:33:19.730 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:33:19.730 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:33:19.730 Verification LBA range: start 0x0 length 0x4000 00:33:19.730 Nvme1n1 : 15.00 14305.07 55.88 11360.94 0.00 4969.07 314.03 1031488.09 00:33:19.730 =================================================================================================================== 00:33:19.730 Total : 14305.07 55.88 11360.94 0.00 4969.07 314.03 1031488.09 00:33:19.730 01:07:25 -- host/bdevperf.sh@39 -- # sync 00:33:19.730 01:07:25 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:33:19.730 01:07:25 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:19.730 01:07:25 -- common/autotest_common.sh@10 -- # set +x 00:33:19.730 01:07:25 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:19.730 01:07:25 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:33:19.730 01:07:25 -- host/bdevperf.sh@44 -- # nvmftestfini 00:33:19.730 01:07:25 -- nvmf/common.sh@477 -- # nvmfcleanup 00:33:19.730 01:07:25 -- nvmf/common.sh@117 -- # sync 00:33:19.730 01:07:25 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:33:19.730 01:07:25 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:33:19.730 01:07:25 -- nvmf/common.sh@120 -- # set +e 00:33:19.730 01:07:25 -- nvmf/common.sh@121 -- # for i in {1..20} 00:33:19.730 01:07:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:33:19.730 rmmod nvme_rdma 00:33:19.730 rmmod nvme_fabrics 00:33:19.730 01:07:25 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:33:19.730 01:07:25 -- nvmf/common.sh@124 -- # set -e 00:33:19.730 01:07:25 -- nvmf/common.sh@125 -- # return 0 00:33:19.730 01:07:25 -- nvmf/common.sh@478 -- # '[' -n 531051 ']' 00:33:19.730 01:07:25 -- nvmf/common.sh@479 -- # killprocess 531051 00:33:19.730 01:07:25 -- common/autotest_common.sh@936 -- # '[' -z 531051 ']' 00:33:19.730 01:07:25 -- common/autotest_common.sh@940 -- # kill -0 531051 00:33:19.730 01:07:25 -- common/autotest_common.sh@941 -- # uname 00:33:19.730 01:07:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:19.730 01:07:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 531051 00:33:19.730 01:07:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:33:19.730 01:07:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:33:19.730 01:07:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 531051' 00:33:19.730 killing process with pid 531051 00:33:19.730 01:07:25 -- common/autotest_common.sh@955 -- # kill 531051 00:33:19.730 01:07:25 -- common/autotest_common.sh@960 -- # wait 531051 00:33:19.730 [2024-04-26 01:07:25.530512] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:33:19.730 01:07:25 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:33:19.730 01:07:25 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:33:19.730 00:33:19.730 real 0m23.752s 00:33:19.730 user 1m3.926s 00:33:19.730 sys 0m4.760s 00:33:19.730 01:07:25 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:19.730 01:07:25 -- common/autotest_common.sh@10 -- # set +x 00:33:19.730 ************************************ 00:33:19.730 END TEST nvmf_bdevperf 00:33:19.730 ************************************ 00:33:19.730 01:07:25 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:33:19.730 01:07:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:33:19.730 01:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:19.730 01:07:25 -- common/autotest_common.sh@10 -- # set +x 00:33:19.730 ************************************ 00:33:19.730 START TEST nvmf_target_disconnect 00:33:19.730 ************************************ 00:33:19.730 01:07:25 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:33:19.730 * Looking for test storage... 00:33:19.730 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:33:19.730 01:07:25 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:33:19.730 01:07:25 -- nvmf/common.sh@7 -- # uname -s 00:33:19.730 01:07:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:19.730 01:07:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:19.730 01:07:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:19.730 01:07:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:19.730 01:07:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:19.730 01:07:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:19.730 01:07:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:19.730 01:07:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:19.730 01:07:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:19.730 01:07:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:19.730 01:07:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:33:19.730 01:07:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:33:19.730 01:07:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:19.730 01:07:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:19.730 01:07:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:19.730 01:07:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:33:19.730 01:07:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:33:19.730 01:07:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:19.730 01:07:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:19.730 01:07:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:19.731 01:07:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:19.731 01:07:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:19.731 01:07:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:19.731 01:07:26 -- paths/export.sh@5 -- # export PATH 00:33:19.731 01:07:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:19.731 01:07:26 -- nvmf/common.sh@47 -- # : 0 00:33:19.731 01:07:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:33:19.731 01:07:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:33:19.731 01:07:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:33:19.731 01:07:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:19.731 01:07:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:19.731 01:07:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:33:19.731 01:07:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:33:19.731 01:07:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:33:19.731 01:07:26 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:33:19.731 01:07:26 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:33:19.731 01:07:26 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:33:19.731 01:07:26 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:33:19.731 01:07:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:33:19.731 01:07:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:19.731 01:07:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:33:19.731 01:07:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:33:19.731 01:07:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:33:19.731 01:07:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:19.731 01:07:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:33:19.731 01:07:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:19.731 01:07:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:33:19.731 01:07:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:33:19.731 01:07:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:33:19.731 01:07:26 -- common/autotest_common.sh@10 -- # set +x 00:33:23.927 01:07:30 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:33:23.927 01:07:30 -- nvmf/common.sh@291 -- # pci_devs=() 00:33:23.927 01:07:30 -- nvmf/common.sh@291 -- # local -a pci_devs 00:33:23.927 01:07:30 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:33:23.927 01:07:30 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:33:23.927 01:07:30 -- nvmf/common.sh@293 -- # pci_drivers=() 00:33:23.927 01:07:30 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:33:23.927 01:07:30 -- nvmf/common.sh@295 -- # net_devs=() 00:33:23.927 01:07:30 -- nvmf/common.sh@295 -- # local -ga net_devs 00:33:23.927 01:07:30 -- nvmf/common.sh@296 -- # e810=() 00:33:23.927 01:07:30 -- nvmf/common.sh@296 -- # local -ga e810 00:33:23.927 01:07:30 -- nvmf/common.sh@297 -- # x722=() 00:33:23.927 01:07:30 -- nvmf/common.sh@297 -- # local -ga x722 00:33:23.927 01:07:30 -- nvmf/common.sh@298 -- # mlx=() 00:33:23.927 01:07:30 -- nvmf/common.sh@298 -- # local -ga mlx 00:33:23.927 01:07:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:33:23.927 01:07:30 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:33:23.927 01:07:30 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:33:23.927 01:07:30 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:33:23.927 01:07:30 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:33:23.927 01:07:30 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:33:23.927 01:07:30 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:33:23.927 01:07:30 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:33:23.928 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:33:23.928 01:07:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:23.928 01:07:30 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:33:23.928 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:33:23.928 01:07:30 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:33:23.928 01:07:30 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:23.928 01:07:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:23.928 01:07:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:33:23.928 Found net devices under 0000:18:00.0: mlx_0_0 00:33:23.928 01:07:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:23.928 01:07:30 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:33:23.928 01:07:30 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:33:23.928 01:07:30 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:33:23.928 Found net devices under 0000:18:00.1: mlx_0_1 00:33:23.928 01:07:30 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:33:23.928 01:07:30 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@403 -- # is_hw=yes 00:33:23.928 01:07:30 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@409 -- # rdma_device_init 00:33:23.928 01:07:30 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:33:23.928 01:07:30 -- nvmf/common.sh@58 -- # uname 00:33:23.928 01:07:30 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:33:23.928 01:07:30 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:33:23.928 01:07:30 -- nvmf/common.sh@63 -- # modprobe ib_core 00:33:23.928 01:07:30 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:33:23.928 01:07:30 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:33:23.928 01:07:30 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:33:23.928 01:07:30 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:33:23.928 01:07:30 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:33:23.928 01:07:30 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:33:23.928 01:07:30 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:33:23.928 01:07:30 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:33:23.928 01:07:30 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:23.928 01:07:30 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:23.928 01:07:30 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:23.928 01:07:30 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:23.928 01:07:30 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:23.928 01:07:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:23.928 01:07:30 -- nvmf/common.sh@105 -- # continue 2 00:33:23.928 01:07:30 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:30 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:23.928 01:07:30 -- nvmf/common.sh@105 -- # continue 2 00:33:23.928 01:07:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:23.928 01:07:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:33:23.928 01:07:30 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:23.928 01:07:30 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:33:23.928 01:07:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:33:23.928 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:23.928 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:33:23.928 altname enp24s0f0np0 00:33:23.928 altname ens785f0np0 00:33:23.928 inet 192.168.100.8/24 scope global mlx_0_0 00:33:23.928 valid_lft forever preferred_lft forever 00:33:23.928 01:07:30 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:33:23.928 01:07:30 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:33:23.928 01:07:30 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:23.928 01:07:30 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:23.928 01:07:30 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:33:23.928 01:07:30 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:33:23.928 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:33:23.928 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:33:23.928 altname enp24s0f1np1 00:33:23.928 altname ens785f1np1 00:33:23.928 inet 192.168.100.9/24 scope global mlx_0_1 00:33:23.928 valid_lft forever preferred_lft forever 00:33:23.928 01:07:30 -- nvmf/common.sh@411 -- # return 0 00:33:23.928 01:07:30 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:33:23.928 01:07:30 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:33:23.928 01:07:30 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:33:23.928 01:07:30 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:33:23.928 01:07:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:33:23.928 01:07:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:33:23.928 01:07:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:33:23.928 01:07:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:33:23.928 01:07:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:33:23.928 01:07:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:33:23.928 01:07:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:23.928 01:07:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:33:23.928 01:07:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:33:23.928 01:07:31 -- nvmf/common.sh@105 -- # continue 2 00:33:23.928 01:07:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:33:23.928 01:07:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:33:23.928 01:07:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:33:23.928 01:07:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:33:23.928 01:07:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:33:23.928 01:07:31 -- nvmf/common.sh@105 -- # continue 2 00:33:23.928 01:07:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:23.928 01:07:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:33:23.928 01:07:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:23.928 01:07:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:33:23.928 01:07:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:33:23.928 01:07:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:33:23.928 01:07:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:33:23.928 01:07:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:33:23.928 192.168.100.9' 00:33:23.928 01:07:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:33:23.928 192.168.100.9' 00:33:23.928 01:07:31 -- nvmf/common.sh@446 -- # head -n 1 00:33:23.928 01:07:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:33:23.928 01:07:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:33:23.928 192.168.100.9' 00:33:23.928 01:07:31 -- nvmf/common.sh@447 -- # tail -n +2 00:33:23.928 01:07:31 -- nvmf/common.sh@447 -- # head -n 1 00:33:23.928 01:07:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:33:23.928 01:07:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:33:23.928 01:07:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:33:23.928 01:07:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:33:23.928 01:07:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:33:23.928 01:07:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:33:23.928 01:07:31 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:33:23.928 01:07:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:23.928 01:07:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:23.928 01:07:31 -- common/autotest_common.sh@10 -- # set +x 00:33:24.188 ************************************ 00:33:24.188 START TEST nvmf_target_disconnect_tc1 00:33:24.188 ************************************ 00:33:24.188 01:07:31 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc1 00:33:24.188 01:07:31 -- host/target_disconnect.sh@32 -- # set +e 00:33:24.188 01:07:31 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:24.188 EAL: No free 2048 kB hugepages reported on node 1 00:33:24.188 [2024-04-26 01:07:31.267150] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:24.188 [2024-04-26 01:07:31.267209] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:24.188 [2024-04-26 01:07:31.267217] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:33:25.125 [2024-04-26 01:07:32.271183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:25.126 [2024-04-26 01:07:32.271237] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:33:25.126 [2024-04-26 01:07:32.271280] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:33:25.126 [2024-04-26 01:07:32.271329] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:33:25.126 [2024-04-26 01:07:32.271350] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:33:25.126 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:33:25.126 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:33:25.126 Initializing NVMe Controllers 00:33:25.126 01:07:32 -- host/target_disconnect.sh@33 -- # trap - ERR 00:33:25.126 01:07:32 -- host/target_disconnect.sh@33 -- # print_backtrace 00:33:25.126 01:07:32 -- common/autotest_common.sh@1139 -- # [[ hxBET =~ e ]] 00:33:25.126 01:07:32 -- common/autotest_common.sh@1139 -- # return 0 00:33:25.126 01:07:32 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:33:25.126 01:07:32 -- host/target_disconnect.sh@41 -- # set -e 00:33:25.126 00:33:25.126 real 0m1.098s 00:33:25.126 user 0m0.942s 00:33:25.126 sys 0m0.145s 00:33:25.126 01:07:32 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:25.126 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:33:25.126 ************************************ 00:33:25.126 END TEST nvmf_target_disconnect_tc1 00:33:25.126 ************************************ 00:33:25.126 01:07:32 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:33:25.126 01:07:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:25.126 01:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:25.126 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:33:25.385 ************************************ 00:33:25.386 START TEST nvmf_target_disconnect_tc2 00:33:25.386 ************************************ 00:33:25.386 01:07:32 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc2 00:33:25.386 01:07:32 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:33:25.386 01:07:32 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:25.386 01:07:32 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:25.386 01:07:32 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:25.386 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:33:25.386 01:07:32 -- nvmf/common.sh@470 -- # nvmfpid=536181 00:33:25.386 01:07:32 -- nvmf/common.sh@471 -- # waitforlisten 536181 00:33:25.386 01:07:32 -- common/autotest_common.sh@817 -- # '[' -z 536181 ']' 00:33:25.386 01:07:32 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:25.386 01:07:32 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:25.386 01:07:32 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:25.386 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:25.386 01:07:32 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:25.386 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:33:25.386 01:07:32 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:25.386 [2024-04-26 01:07:32.489180] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:25.386 [2024-04-26 01:07:32.489220] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:25.386 EAL: No free 2048 kB hugepages reported on node 1 00:33:25.386 [2024-04-26 01:07:32.557473] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:25.645 [2024-04-26 01:07:32.628823] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:25.645 [2024-04-26 01:07:32.628854] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:25.645 [2024-04-26 01:07:32.628860] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:25.645 [2024-04-26 01:07:32.628865] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:25.645 [2024-04-26 01:07:32.628869] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:25.645 [2024-04-26 01:07:32.628981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:25.645 [2024-04-26 01:07:32.629106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:25.645 [2024-04-26 01:07:32.629215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:25.645 [2024-04-26 01:07:32.629216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:26.213 01:07:33 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:26.213 01:07:33 -- common/autotest_common.sh@850 -- # return 0 00:33:26.213 01:07:33 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:26.213 01:07:33 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:26.213 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.213 01:07:33 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:26.213 01:07:33 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:26.213 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.213 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.213 Malloc0 00:33:26.213 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.213 01:07:33 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:26.213 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.213 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.213 [2024-04-26 01:07:33.336360] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc81930/0xc8d540) succeed. 00:33:26.213 [2024-04-26 01:07:33.345876] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc82f70/0xd2d5d0) succeed. 00:33:26.472 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.472 01:07:33 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:26.472 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.472 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.472 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.472 01:07:33 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:26.472 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.472 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.472 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.472 01:07:33 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:26.472 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.472 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.473 [2024-04-26 01:07:33.473889] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:26.473 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.473 01:07:33 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:26.473 01:07:33 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:26.473 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:33:26.473 01:07:33 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:26.473 01:07:33 -- host/target_disconnect.sh@50 -- # reconnectpid=536361 00:33:26.473 01:07:33 -- host/target_disconnect.sh@52 -- # sleep 2 00:33:26.473 01:07:33 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:33:26.473 EAL: No free 2048 kB hugepages reported on node 1 00:33:28.378 01:07:35 -- host/target_disconnect.sh@53 -- # kill -9 536181 00:33:28.378 01:07:35 -- host/target_disconnect.sh@55 -- # sleep 2 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Read completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.756 Write completed with error (sct=0, sc=8) 00:33:29.756 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Write completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 Read completed with error (sct=0, sc=8) 00:33:29.757 starting I/O failed 00:33:29.757 [2024-04-26 01:07:36.640484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:30.326 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 536181 Killed "${NVMF_APP[@]}" "$@" 00:33:30.326 01:07:37 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:33:30.326 01:07:37 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:30.326 01:07:37 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:30.326 01:07:37 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:30.326 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.326 01:07:37 -- nvmf/common.sh@470 -- # nvmfpid=537005 00:33:30.326 01:07:37 -- nvmf/common.sh@471 -- # waitforlisten 537005 00:33:30.326 01:07:37 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:30.326 01:07:37 -- common/autotest_common.sh@817 -- # '[' -z 537005 ']' 00:33:30.326 01:07:37 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:30.326 01:07:37 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:30.326 01:07:37 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:30.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:30.326 01:07:37 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:30.326 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.586 [2024-04-26 01:07:37.522038] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:30.586 [2024-04-26 01:07:37.522077] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:30.586 EAL: No free 2048 kB hugepages reported on node 1 00:33:30.586 [2024-04-26 01:07:37.579044] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Read completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 Write completed with error (sct=0, sc=8) 00:33:30.586 starting I/O failed 00:33:30.586 [2024-04-26 01:07:37.645428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:30.586 [2024-04-26 01:07:37.646932] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:30.586 [2024-04-26 01:07:37.646948] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:30.586 [2024-04-26 01:07:37.646954] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:30.586 [2024-04-26 01:07:37.668530] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:30.586 [2024-04-26 01:07:37.668561] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:30.586 [2024-04-26 01:07:37.668572] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:30.586 [2024-04-26 01:07:37.668580] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:30.586 [2024-04-26 01:07:37.668587] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:30.586 [2024-04-26 01:07:37.668701] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:30.586 [2024-04-26 01:07:37.668806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:30.586 [2024-04-26 01:07:37.668910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:30.586 [2024-04-26 01:07:37.668912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:30.586 01:07:37 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:30.586 01:07:37 -- common/autotest_common.sh@850 -- # return 0 00:33:30.586 01:07:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:30.586 01:07:37 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:30.586 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 01:07:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:30.846 01:07:37 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 Malloc0 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 [2024-04-26 01:07:37.844391] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1712930/0x171e540) succeed. 00:33:30.846 [2024-04-26 01:07:37.853936] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1713f70/0x17be5d0) succeed. 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 [2024-04-26 01:07:37.981695] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:33:30.846 01:07:37 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:30.846 01:07:37 -- common/autotest_common.sh@10 -- # set +x 00:33:30.846 01:07:37 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:30.846 01:07:37 -- host/target_disconnect.sh@58 -- # wait 536361 00:33:31.785 [2024-04-26 01:07:38.650872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.654043] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.654092] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.654109] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.654116] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.654122] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.664492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.674163] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.674198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.674212] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.674218] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.674223] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.684576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.694226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.694262] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.694276] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.694282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.694288] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.704428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.714270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.714308] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.714324] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.714330] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.714336] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.724646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.734270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.734310] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.734325] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.734331] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.734337] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.744531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.754336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.754373] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.754386] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.754392] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.754398] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.764637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.785 [2024-04-26 01:07:38.774367] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.785 [2024-04-26 01:07:38.774402] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.785 [2024-04-26 01:07:38.774416] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.785 [2024-04-26 01:07:38.774422] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.785 [2024-04-26 01:07:38.774428] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.785 [2024-04-26 01:07:38.784651] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.785 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.794390] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.794426] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.794440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.794446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.794454] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.804832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.814542] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.814579] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.814592] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.814598] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.814603] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.824868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.834522] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.834553] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.834567] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.834573] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.834579] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.844934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.854606] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.854642] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.854656] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.854662] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.854668] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.865114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.874652] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.874686] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.874698] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.874704] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.874710] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.884950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.894750] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.894786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.894798] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.894804] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.894810] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.905065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.914826] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.914862] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.914879] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.914886] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.914891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.925101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.934892] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.934925] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.934939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.934945] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.934951] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.945139] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.954988] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.955024] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.955037] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.955043] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.955048] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:31.786 [2024-04-26 01:07:38.965226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:31.786 qpair failed and we were unable to recover it. 00:33:31.786 [2024-04-26 01:07:38.974995] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:31.786 [2024-04-26 01:07:38.975035] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:31.786 [2024-04-26 01:07:38.975050] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:31.786 [2024-04-26 01:07:38.975057] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:31.786 [2024-04-26 01:07:38.975062] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.047 [2024-04-26 01:07:38.985295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.047 qpair failed and we were unable to recover it. 00:33:32.047 [2024-04-26 01:07:38.995093] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.047 [2024-04-26 01:07:38.995129] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.047 [2024-04-26 01:07:38.995142] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.047 [2024-04-26 01:07:38.995148] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.047 [2024-04-26 01:07:38.995153] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.047 [2024-04-26 01:07:39.005458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.047 qpair failed and we were unable to recover it. 00:33:32.047 [2024-04-26 01:07:39.015041] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.047 [2024-04-26 01:07:39.015075] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.047 [2024-04-26 01:07:39.015088] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.047 [2024-04-26 01:07:39.015094] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.047 [2024-04-26 01:07:39.015100] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.047 [2024-04-26 01:07:39.025388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.047 qpair failed and we were unable to recover it. 00:33:32.047 [2024-04-26 01:07:39.035177] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.047 [2024-04-26 01:07:39.035213] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.047 [2024-04-26 01:07:39.035227] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.047 [2024-04-26 01:07:39.035233] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.047 [2024-04-26 01:07:39.035242] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.047 [2024-04-26 01:07:39.045384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.047 qpair failed and we were unable to recover it. 00:33:32.047 [2024-04-26 01:07:39.055246] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.047 [2024-04-26 01:07:39.055284] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.047 [2024-04-26 01:07:39.055298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.047 [2024-04-26 01:07:39.055304] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.047 [2024-04-26 01:07:39.055309] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.047 [2024-04-26 01:07:39.065494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.047 qpair failed and we were unable to recover it. 00:33:32.047 [2024-04-26 01:07:39.075270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.047 [2024-04-26 01:07:39.075305] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.047 [2024-04-26 01:07:39.075318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.047 [2024-04-26 01:07:39.075324] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.047 [2024-04-26 01:07:39.075329] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.085710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.095330] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.095361] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.095374] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.095380] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.095386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.105666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.115389] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.115424] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.115438] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.115444] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.115450] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.125746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.135489] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.135525] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.135538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.135544] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.135549] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.145779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.155520] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.155558] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.155573] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.155579] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.155584] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.165977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.175568] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.175603] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.175616] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.175622] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.175627] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.185810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.195615] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.195654] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.195667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.195673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.195679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.206081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.215661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.215696] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.215708] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.215715] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.215720] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.048 [2024-04-26 01:07:39.226045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.048 qpair failed and we were unable to recover it. 00:33:32.048 [2024-04-26 01:07:39.235763] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.048 [2024-04-26 01:07:39.235804] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.048 [2024-04-26 01:07:39.235817] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.048 [2024-04-26 01:07:39.235823] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.048 [2024-04-26 01:07:39.235831] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.246094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.255874] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.255907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.255920] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.255926] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.255932] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.266144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.275901] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.275937] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.275950] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.275957] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.275962] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.286175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.295886] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.295925] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.295938] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.295944] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.295950] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.306186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.315914] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.315952] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.315965] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.315971] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.315976] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.326396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.336027] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.336064] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.336078] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.336084] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.336089] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.346151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.309 [2024-04-26 01:07:39.356110] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.309 [2024-04-26 01:07:39.356146] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.309 [2024-04-26 01:07:39.356159] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.309 [2024-04-26 01:07:39.356165] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.309 [2024-04-26 01:07:39.356171] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.309 [2024-04-26 01:07:39.366570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.309 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.376073] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.376111] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.376124] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.376130] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.376136] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.386355] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.396175] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.396210] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.396223] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.396229] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.396235] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.406588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.416265] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.416298] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.416314] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.416320] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.416326] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.426552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.436265] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.436299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.436312] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.436319] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.436324] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.446698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.456302] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.456337] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.456350] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.456356] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.456361] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.466773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.476425] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.476460] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.476472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.476479] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.476484] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.310 [2024-04-26 01:07:39.486777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.310 qpair failed and we were unable to recover it. 00:33:32.310 [2024-04-26 01:07:39.496371] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.310 [2024-04-26 01:07:39.496401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.310 [2024-04-26 01:07:39.496414] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.310 [2024-04-26 01:07:39.496420] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.310 [2024-04-26 01:07:39.496426] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.506811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.516544] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.516580] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.516593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.516599] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.516604] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.526930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.536634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.536670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.536683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.536689] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.536695] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.547085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.556700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.556735] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.556748] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.556753] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.556759] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.566843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.576640] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.576673] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.576686] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.576692] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.576697] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.586925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.596704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.596739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.596755] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.596761] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.596766] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.607071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.616792] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.616831] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.616844] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.616850] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.616855] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.627066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.636934] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.636974] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.636987] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.636994] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.636999] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.647352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.656985] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.657021] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.657034] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.657040] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.657045] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.667294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.571 qpair failed and we were unable to recover it. 00:33:32.571 [2024-04-26 01:07:39.676954] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.571 [2024-04-26 01:07:39.676988] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.571 [2024-04-26 01:07:39.677001] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.571 [2024-04-26 01:07:39.677007] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.571 [2024-04-26 01:07:39.677015] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.571 [2024-04-26 01:07:39.687520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.572 qpair failed and we were unable to recover it. 00:33:32.572 [2024-04-26 01:07:39.697104] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.572 [2024-04-26 01:07:39.697141] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.572 [2024-04-26 01:07:39.697153] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.572 [2024-04-26 01:07:39.697159] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.572 [2024-04-26 01:07:39.697165] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.572 [2024-04-26 01:07:39.707280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.572 qpair failed and we were unable to recover it. 00:33:32.572 [2024-04-26 01:07:39.717079] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.572 [2024-04-26 01:07:39.717121] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.572 [2024-04-26 01:07:39.717134] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.572 [2024-04-26 01:07:39.717140] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.572 [2024-04-26 01:07:39.717145] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.572 [2024-04-26 01:07:39.727541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.572 qpair failed and we were unable to recover it. 00:33:32.572 [2024-04-26 01:07:39.737120] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.572 [2024-04-26 01:07:39.737152] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.572 [2024-04-26 01:07:39.737165] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.572 [2024-04-26 01:07:39.737171] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.572 [2024-04-26 01:07:39.737177] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.572 [2024-04-26 01:07:39.747567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.572 qpair failed and we were unable to recover it. 00:33:32.572 [2024-04-26 01:07:39.757198] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.572 [2024-04-26 01:07:39.757231] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.572 [2024-04-26 01:07:39.757249] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.572 [2024-04-26 01:07:39.757255] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.572 [2024-04-26 01:07:39.757260] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.832 [2024-04-26 01:07:39.767590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.832 qpair failed and we were unable to recover it. 00:33:32.832 [2024-04-26 01:07:39.777312] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.832 [2024-04-26 01:07:39.777344] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.832 [2024-04-26 01:07:39.777357] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.832 [2024-04-26 01:07:39.777362] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.832 [2024-04-26 01:07:39.777367] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.832 [2024-04-26 01:07:39.787726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.832 qpair failed and we were unable to recover it. 00:33:32.832 [2024-04-26 01:07:39.797503] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.832 [2024-04-26 01:07:39.797538] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.832 [2024-04-26 01:07:39.797550] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.832 [2024-04-26 01:07:39.797556] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.797561] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.807767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.817316] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.817356] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.817369] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.817375] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.817380] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.827776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.837541] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.837574] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.837587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.837594] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.837600] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.847823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.857555] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.857594] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.857609] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.857615] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.857621] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.867979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.877553] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.877591] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.877604] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.877610] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.877616] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.887920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.897671] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.897713] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.897725] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.897731] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.897736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.907931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.917753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.917792] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.917804] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.917810] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.917816] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.928216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.937677] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.937715] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.937728] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.937735] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.937740] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.948224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.957857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.957896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.957909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.957915] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.957921] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.968156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.977886] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.977922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.977934] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.977940] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.977946] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:39.988153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:39.997882] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:39.997917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:39.997929] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:39.997935] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:39.997940] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:32.833 [2024-04-26 01:07:40.008308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:32.833 qpair failed and we were unable to recover it. 00:33:32.833 [2024-04-26 01:07:40.018012] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:32.833 [2024-04-26 01:07:40.018045] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:32.833 [2024-04-26 01:07:40.018059] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:32.833 [2024-04-26 01:07:40.018065] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:32.833 [2024-04-26 01:07:40.018071] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.028309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.038035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.038070] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.038088] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.038095] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.038101] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.048439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.058086] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.058122] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.058135] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.058141] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.058147] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.068419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.078241] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.078274] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.078287] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.078293] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.078298] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.088544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.098270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.098313] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.098326] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.098332] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.098337] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.108531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.118285] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.118317] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.118330] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.118336] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.118344] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.128607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.138371] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.138402] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.138415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.138421] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.138427] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.148623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.158445] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.158480] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.094 [2024-04-26 01:07:40.158493] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.094 [2024-04-26 01:07:40.158499] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.094 [2024-04-26 01:07:40.158505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.094 [2024-04-26 01:07:40.168757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.094 qpair failed and we were unable to recover it. 00:33:33.094 [2024-04-26 01:07:40.178614] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.094 [2024-04-26 01:07:40.178652] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.178665] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.178672] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.178678] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.095 [2024-04-26 01:07:40.188813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.095 qpair failed and we were unable to recover it. 00:33:33.095 [2024-04-26 01:07:40.198632] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.095 [2024-04-26 01:07:40.198665] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.198678] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.198684] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.198689] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.095 [2024-04-26 01:07:40.208970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.095 qpair failed and we were unable to recover it. 00:33:33.095 [2024-04-26 01:07:40.218678] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.095 [2024-04-26 01:07:40.218711] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.218724] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.218730] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.218736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.095 [2024-04-26 01:07:40.229021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.095 qpair failed and we were unable to recover it. 00:33:33.095 [2024-04-26 01:07:40.238681] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.095 [2024-04-26 01:07:40.238715] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.238728] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.238734] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.238739] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.095 [2024-04-26 01:07:40.249030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.095 qpair failed and we were unable to recover it. 00:33:33.095 [2024-04-26 01:07:40.258716] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.095 [2024-04-26 01:07:40.258757] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.258770] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.258776] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.258782] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.095 [2024-04-26 01:07:40.269136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.095 qpair failed and we were unable to recover it. 00:33:33.095 [2024-04-26 01:07:40.278843] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.095 [2024-04-26 01:07:40.278877] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.095 [2024-04-26 01:07:40.278889] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.095 [2024-04-26 01:07:40.278895] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.095 [2024-04-26 01:07:40.278900] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.355 [2024-04-26 01:07:40.289068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.355 qpair failed and we were unable to recover it. 00:33:33.355 [2024-04-26 01:07:40.298803] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.355 [2024-04-26 01:07:40.298838] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.355 [2024-04-26 01:07:40.298854] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.355 [2024-04-26 01:07:40.298860] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.355 [2024-04-26 01:07:40.298865] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.309180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.318965] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.318999] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.319011] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.319018] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.319023] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.329306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.338927] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.338963] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.338976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.338982] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.338988] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.349383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.359042] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.359075] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.359087] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.359093] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.359099] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.369453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.379093] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.379126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.379138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.379145] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.379150] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.389385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.399035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.399067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.399080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.399086] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.399091] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.409430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.419244] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.419280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.419293] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.419299] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.419304] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.429666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.439386] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.439418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.439431] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.439437] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.439443] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.449529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.459249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.459280] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.459293] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.459299] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.459305] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.469768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.479324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.479363] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.479375] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.479382] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.479387] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.489743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.499373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.499408] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.499421] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.499427] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.356 [2024-04-26 01:07:40.499433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.356 [2024-04-26 01:07:40.509696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.356 qpair failed and we were unable to recover it. 00:33:33.356 [2024-04-26 01:07:40.519383] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.356 [2024-04-26 01:07:40.519415] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.356 [2024-04-26 01:07:40.519428] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.356 [2024-04-26 01:07:40.519434] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.357 [2024-04-26 01:07:40.519440] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.357 [2024-04-26 01:07:40.529909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.357 qpair failed and we were unable to recover it. 00:33:33.357 [2024-04-26 01:07:40.539501] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.357 [2024-04-26 01:07:40.539539] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.357 [2024-04-26 01:07:40.539552] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.357 [2024-04-26 01:07:40.539558] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.357 [2024-04-26 01:07:40.539563] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.550144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.559511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.559546] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.559559] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.559565] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.559573] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.569954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.579632] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.579672] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.579685] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.579691] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.579696] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.590067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.599582] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.599612] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.599625] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.599631] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.599636] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.610074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.619697] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.619730] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.619743] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.619748] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.619754] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.630234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.639764] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.639800] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.639813] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.639820] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.639825] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.650146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.617 qpair failed and we were unable to recover it. 00:33:33.617 [2024-04-26 01:07:40.659887] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.617 [2024-04-26 01:07:40.659923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.617 [2024-04-26 01:07:40.659938] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.617 [2024-04-26 01:07:40.659944] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.617 [2024-04-26 01:07:40.659950] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.617 [2024-04-26 01:07:40.670523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.679867] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.679898] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.679911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.679918] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.679923] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.690312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.699909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.699948] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.699961] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.699967] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.699973] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.710403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.720076] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.720110] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.720123] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.720129] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.720135] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.730500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.740057] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.740099] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.740114] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.740120] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.740125] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.750645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.760130] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.760167] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.760180] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.760187] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.760192] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.770582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.780191] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.780230] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.780247] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.780253] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.780259] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.618 [2024-04-26 01:07:40.790626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.618 qpair failed and we were unable to recover it. 00:33:33.618 [2024-04-26 01:07:40.800172] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.618 [2024-04-26 01:07:40.800208] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.618 [2024-04-26 01:07:40.800221] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.618 [2024-04-26 01:07:40.800227] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.618 [2024-04-26 01:07:40.800232] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.810497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.820439] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.820477] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.820490] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.820496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.820502] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.830803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.840323] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.840362] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.840375] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.840381] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.840386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.850728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.860362] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.860395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.860408] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.860414] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.860420] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.870899] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.880424] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.880458] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.880470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.880477] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.880482] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.890939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.900514] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.900554] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.900566] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.900573] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.900578] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.910969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.920519] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.920561] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.920573] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.920579] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.920585] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.931004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.940753] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.940790] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.940803] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.940809] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.940815] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.951061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.960664] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.960698] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.960711] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.960717] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.879 [2024-04-26 01:07:40.960722] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.879 [2024-04-26 01:07:40.971191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.879 qpair failed and we were unable to recover it. 00:33:33.879 [2024-04-26 01:07:40.980686] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.879 [2024-04-26 01:07:40.980719] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.879 [2024-04-26 01:07:40.980732] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.879 [2024-04-26 01:07:40.980738] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.880 [2024-04-26 01:07:40.980743] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.880 [2024-04-26 01:07:40.991215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.880 qpair failed and we were unable to recover it. 00:33:33.880 [2024-04-26 01:07:41.000848] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.880 [2024-04-26 01:07:41.000882] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.880 [2024-04-26 01:07:41.000896] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.880 [2024-04-26 01:07:41.000903] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.880 [2024-04-26 01:07:41.000911] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.880 [2024-04-26 01:07:41.011366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.880 qpair failed and we were unable to recover it. 00:33:33.880 [2024-04-26 01:07:41.020884] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.880 [2024-04-26 01:07:41.020923] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.880 [2024-04-26 01:07:41.020935] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.880 [2024-04-26 01:07:41.020941] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.880 [2024-04-26 01:07:41.020946] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.880 [2024-04-26 01:07:41.031076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.880 qpair failed and we were unable to recover it. 00:33:33.880 [2024-04-26 01:07:41.040940] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.880 [2024-04-26 01:07:41.040976] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.880 [2024-04-26 01:07:41.040989] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.880 [2024-04-26 01:07:41.040995] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.880 [2024-04-26 01:07:41.041000] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:33.880 [2024-04-26 01:07:41.051459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:33.880 qpair failed and we were unable to recover it. 00:33:33.880 [2024-04-26 01:07:41.060957] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:33.880 [2024-04-26 01:07:41.060991] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:33.880 [2024-04-26 01:07:41.061004] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:33.880 [2024-04-26 01:07:41.061010] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:33.880 [2024-04-26 01:07:41.061015] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.071552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.080883] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.080920] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.080932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.080938] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.080944] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.091445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.101016] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.101051] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.101065] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.101071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.101076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.111461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.121154] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.121186] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.121199] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.121205] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.121211] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.131527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.141223] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.141259] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.141272] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.141279] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.141284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.151618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.161265] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.161299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.161312] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.161318] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.161323] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.171853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.181282] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.181316] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.181332] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.181338] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.181343] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.191703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.201411] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.201446] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.201458] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.201464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.201470] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.211801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.221402] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.221439] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.221452] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.221459] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.221464] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.231816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.241559] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.141 [2024-04-26 01:07:41.241590] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.141 [2024-04-26 01:07:41.241602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.141 [2024-04-26 01:07:41.241609] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.141 [2024-04-26 01:07:41.241614] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.141 [2024-04-26 01:07:41.251917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.141 qpair failed and we were unable to recover it. 00:33:34.141 [2024-04-26 01:07:41.261611] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.142 [2024-04-26 01:07:41.261642] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.142 [2024-04-26 01:07:41.261655] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.142 [2024-04-26 01:07:41.261662] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.142 [2024-04-26 01:07:41.261667] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.142 [2024-04-26 01:07:41.271978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.142 qpair failed and we were unable to recover it. 00:33:34.142 [2024-04-26 01:07:41.281680] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.142 [2024-04-26 01:07:41.281718] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.142 [2024-04-26 01:07:41.281731] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.142 [2024-04-26 01:07:41.281737] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.142 [2024-04-26 01:07:41.281742] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.142 [2024-04-26 01:07:41.291992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.142 qpair failed and we were unable to recover it. 00:33:34.142 [2024-04-26 01:07:41.301700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.142 [2024-04-26 01:07:41.301739] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.142 [2024-04-26 01:07:41.301752] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.142 [2024-04-26 01:07:41.301758] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.142 [2024-04-26 01:07:41.301763] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.142 [2024-04-26 01:07:41.312120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.142 qpair failed and we were unable to recover it. 00:33:34.142 [2024-04-26 01:07:41.321809] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.142 [2024-04-26 01:07:41.321840] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.142 [2024-04-26 01:07:41.321852] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.142 [2024-04-26 01:07:41.321858] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.142 [2024-04-26 01:07:41.321863] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.142 [2024-04-26 01:07:41.332148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.142 qpair failed and we were unable to recover it. 00:33:34.402 [2024-04-26 01:07:41.341803] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.402 [2024-04-26 01:07:41.341836] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.402 [2024-04-26 01:07:41.341848] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.402 [2024-04-26 01:07:41.341854] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.402 [2024-04-26 01:07:41.341860] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.402 [2024-04-26 01:07:41.352078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.402 qpair failed and we were unable to recover it. 00:33:34.402 [2024-04-26 01:07:41.361835] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.402 [2024-04-26 01:07:41.361874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.361886] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.361892] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.361898] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.372224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.381932] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.381972] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.381984] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.381991] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.381997] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.392191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.401880] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.401920] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.401933] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.401939] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.401945] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.412393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.421888] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.421922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.421935] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.421941] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.421946] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.432284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.442077] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.442111] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.442123] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.442129] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.442137] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.452496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.462114] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.462155] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.462168] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.462174] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.462179] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.472523] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.482214] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.482250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.482263] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.482269] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.482275] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.492646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.502247] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.502283] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.502296] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.502302] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.502308] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.512694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.522226] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.522264] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.522277] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.522284] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.522289] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.532697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.542379] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.542421] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.542434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.542440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.542446] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.403 [2024-04-26 01:07:41.552903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.403 qpair failed and we were unable to recover it. 00:33:34.403 [2024-04-26 01:07:41.562408] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.403 [2024-04-26 01:07:41.562443] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.403 [2024-04-26 01:07:41.562455] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.403 [2024-04-26 01:07:41.562461] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.403 [2024-04-26 01:07:41.562467] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.404 [2024-04-26 01:07:41.572943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.404 qpair failed and we were unable to recover it. 00:33:34.404 [2024-04-26 01:07:41.582437] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.404 [2024-04-26 01:07:41.582466] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.404 [2024-04-26 01:07:41.582479] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.404 [2024-04-26 01:07:41.582484] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.404 [2024-04-26 01:07:41.582490] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.404 [2024-04-26 01:07:41.592919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.404 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.602596] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.602631] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.602644] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.602649] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.602655] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.612973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.622570] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.622605] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.622621] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.622627] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.622633] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.633004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.642721] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.642760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.642773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.642779] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.642784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.653138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.662873] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.662907] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.662920] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.662926] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.662931] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.673251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.682839] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.682875] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.682887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.682893] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.682899] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.693391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.702832] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.702866] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.702879] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.702885] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.702890] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.713321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.723022] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.723057] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.723070] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.723075] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.723081] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.733284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.743024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.743052] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.743064] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.743070] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.664 [2024-04-26 01:07:41.743076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.664 [2024-04-26 01:07:41.753449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.664 qpair failed and we were unable to recover it. 00:33:34.664 [2024-04-26 01:07:41.763007] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.664 [2024-04-26 01:07:41.763041] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.664 [2024-04-26 01:07:41.763054] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.664 [2024-04-26 01:07:41.763060] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.665 [2024-04-26 01:07:41.763065] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.665 [2024-04-26 01:07:41.773432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.665 qpair failed and we were unable to recover it. 00:33:34.665 [2024-04-26 01:07:41.783204] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.665 [2024-04-26 01:07:41.783246] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.665 [2024-04-26 01:07:41.783259] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.665 [2024-04-26 01:07:41.783266] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.665 [2024-04-26 01:07:41.783271] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.665 [2024-04-26 01:07:41.793514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.665 qpair failed and we were unable to recover it. 00:33:34.665 [2024-04-26 01:07:41.803252] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.665 [2024-04-26 01:07:41.803285] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.665 [2024-04-26 01:07:41.803298] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.665 [2024-04-26 01:07:41.803304] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.665 [2024-04-26 01:07:41.803310] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.665 [2024-04-26 01:07:41.813636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.665 qpair failed and we were unable to recover it. 00:33:34.665 [2024-04-26 01:07:41.823267] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.665 [2024-04-26 01:07:41.823299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.665 [2024-04-26 01:07:41.823312] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.665 [2024-04-26 01:07:41.823318] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.665 [2024-04-26 01:07:41.823323] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.665 [2024-04-26 01:07:41.833841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.665 qpair failed and we were unable to recover it. 00:33:34.665 [2024-04-26 01:07:41.843365] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.665 [2024-04-26 01:07:41.843403] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.665 [2024-04-26 01:07:41.843416] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.665 [2024-04-26 01:07:41.843422] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.665 [2024-04-26 01:07:41.843427] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.665 [2024-04-26 01:07:41.853765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.665 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.863460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.863492] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.863505] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.863511] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.863516] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.873798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.883497] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.883531] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.883544] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.883550] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.883558] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.893790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.903563] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.903598] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.903610] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.903616] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.903622] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.913856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.923497] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.923532] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.923545] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.923551] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.923557] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.934045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.943634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.943671] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.943684] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.943690] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.943695] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.954241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.963661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.963693] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.963706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.963712] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.963717] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.974165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:41.983779] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:41.983810] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:41.983823] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:41.983829] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:41.983834] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:41.994118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:42.003802] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:42.003834] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:42.003847] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:42.003853] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:42.003858] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:42.014189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:42.023801] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:42.023837] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:42.023850] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:42.023856] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:42.023862] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:42.034159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:42.043916] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.926 [2024-04-26 01:07:42.043953] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.926 [2024-04-26 01:07:42.043966] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.926 [2024-04-26 01:07:42.043973] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.926 [2024-04-26 01:07:42.043978] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.926 [2024-04-26 01:07:42.054205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.926 qpair failed and we were unable to recover it. 00:33:34.926 [2024-04-26 01:07:42.063903] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.927 [2024-04-26 01:07:42.063932] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.927 [2024-04-26 01:07:42.063950] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.927 [2024-04-26 01:07:42.063956] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.927 [2024-04-26 01:07:42.063961] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.927 [2024-04-26 01:07:42.074373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.927 qpair failed and we were unable to recover it. 00:33:34.927 [2024-04-26 01:07:42.083913] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.927 [2024-04-26 01:07:42.083947] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.927 [2024-04-26 01:07:42.083959] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.927 [2024-04-26 01:07:42.083965] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.927 [2024-04-26 01:07:42.083971] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.927 [2024-04-26 01:07:42.094279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.927 qpair failed and we were unable to recover it. 00:33:34.927 [2024-04-26 01:07:42.104089] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:34.927 [2024-04-26 01:07:42.104126] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:34.927 [2024-04-26 01:07:42.104138] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:34.927 [2024-04-26 01:07:42.104144] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:34.927 [2024-04-26 01:07:42.104150] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:34.927 [2024-04-26 01:07:42.114570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:34.927 qpair failed and we were unable to recover it. 00:33:35.187 [2024-04-26 01:07:42.124206] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.124250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.124263] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.124269] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.124275] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.134599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.144331] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.144367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.144380] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.144387] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.144392] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.154698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.164384] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.164418] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.164431] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.164438] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.164443] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.174808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.184201] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.184247] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.184260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.184267] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.184272] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.194587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.204336] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.204367] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.204380] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.204386] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.204392] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.214813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.224390] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.224427] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.224440] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.224446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.224451] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.234932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.244440] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.244479] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.244492] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.244499] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.244504] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.255007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.264509] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.264545] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.264558] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.264564] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.264570] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.274944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.284511] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.284546] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.284560] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.284566] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.284572] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.295053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.304639] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.304674] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.304687] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.304694] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.304701] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.315035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.324659] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.324693] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.324705] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.324711] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.324719] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.335126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.344630] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.188 [2024-04-26 01:07:42.344668] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.188 [2024-04-26 01:07:42.344681] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.188 [2024-04-26 01:07:42.344688] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.188 [2024-04-26 01:07:42.344693] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.188 [2024-04-26 01:07:42.355187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.188 qpair failed and we were unable to recover it. 00:33:35.188 [2024-04-26 01:07:42.364815] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.189 [2024-04-26 01:07:42.364854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.189 [2024-04-26 01:07:42.364867] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.189 [2024-04-26 01:07:42.364873] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.189 [2024-04-26 01:07:42.364879] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.189 [2024-04-26 01:07:42.375342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.189 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.384863] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.384896] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.384909] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.384915] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.384920] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.395322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.404885] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.404918] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.404932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.404938] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.404943] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.415365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.424986] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.425019] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.425032] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.425038] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.425043] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.435296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.445019] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.445052] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.445064] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.445071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.445076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.455631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.465024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.465060] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.465072] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.465079] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.465084] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.475508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.485132] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.485165] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.485178] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.485184] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.485189] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.495797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.505231] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.505270] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.505285] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.505292] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.505297] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.515642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.525281] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.525317] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.525331] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.450 [2024-04-26 01:07:42.525337] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.450 [2024-04-26 01:07:42.525342] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.450 [2024-04-26 01:07:42.535803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.450 qpair failed and we were unable to recover it. 00:33:35.450 [2024-04-26 01:07:42.545352] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.450 [2024-04-26 01:07:42.545388] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.450 [2024-04-26 01:07:42.545401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.451 [2024-04-26 01:07:42.545407] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.451 [2024-04-26 01:07:42.545412] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.451 [2024-04-26 01:07:42.555907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.451 qpair failed and we were unable to recover it. 00:33:35.451 [2024-04-26 01:07:42.565460] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.451 [2024-04-26 01:07:42.565493] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.451 [2024-04-26 01:07:42.565505] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.451 [2024-04-26 01:07:42.565511] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.451 [2024-04-26 01:07:42.565517] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.451 [2024-04-26 01:07:42.575803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.451 qpair failed and we were unable to recover it. 00:33:35.451 [2024-04-26 01:07:42.585420] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.451 [2024-04-26 01:07:42.585459] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.451 [2024-04-26 01:07:42.585472] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.451 [2024-04-26 01:07:42.585478] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.451 [2024-04-26 01:07:42.585483] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.451 [2024-04-26 01:07:42.595855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.451 qpair failed and we were unable to recover it. 00:33:35.451 [2024-04-26 01:07:42.605549] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.451 [2024-04-26 01:07:42.605587] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.451 [2024-04-26 01:07:42.605599] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.451 [2024-04-26 01:07:42.605606] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.451 [2024-04-26 01:07:42.605611] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.451 [2024-04-26 01:07:42.616015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.451 qpair failed and we were unable to recover it. 00:33:35.451 [2024-04-26 01:07:42.625616] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.451 [2024-04-26 01:07:42.625652] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.451 [2024-04-26 01:07:42.625664] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.451 [2024-04-26 01:07:42.625671] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.451 [2024-04-26 01:07:42.625676] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.451 [2024-04-26 01:07:42.636044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.451 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.645607] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.645638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.645651] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.645657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.645662] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.656033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.665722] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.665760] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.665773] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.665779] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.665784] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.676197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.685767] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.685805] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.685817] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.685823] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.685829] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.696166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.705818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.705854] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.705867] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.705873] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.705879] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.716211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.725831] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.725867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.725880] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.725886] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.725891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.736243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.745907] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.745946] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.745958] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.745964] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.745970] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.756287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.765977] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.766008] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.766021] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.766027] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.766035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.776439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.785996] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.786032] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.786045] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.786051] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.786056] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.796417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.806052] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.806087] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.806100] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.729 [2024-04-26 01:07:42.806106] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.729 [2024-04-26 01:07:42.806112] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.729 [2024-04-26 01:07:42.816485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.729 qpair failed and we were unable to recover it. 00:33:35.729 [2024-04-26 01:07:42.826136] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.729 [2024-04-26 01:07:42.826172] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.729 [2024-04-26 01:07:42.826184] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.730 [2024-04-26 01:07:42.826190] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.730 [2024-04-26 01:07:42.826196] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.730 [2024-04-26 01:07:42.836575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.730 qpair failed and we were unable to recover it. 00:33:35.730 [2024-04-26 01:07:42.846211] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.730 [2024-04-26 01:07:42.846255] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.730 [2024-04-26 01:07:42.846268] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.730 [2024-04-26 01:07:42.846274] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.730 [2024-04-26 01:07:42.846279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.730 [2024-04-26 01:07:42.856709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.730 qpair failed and we were unable to recover it. 00:33:35.730 [2024-04-26 01:07:42.866189] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.730 [2024-04-26 01:07:42.866223] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.730 [2024-04-26 01:07:42.866236] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.730 [2024-04-26 01:07:42.866246] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.730 [2024-04-26 01:07:42.866252] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.730 [2024-04-26 01:07:42.876583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.730 qpair failed and we were unable to recover it. 00:33:35.730 [2024-04-26 01:07:42.886319] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.730 [2024-04-26 01:07:42.886352] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.730 [2024-04-26 01:07:42.886365] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.730 [2024-04-26 01:07:42.886371] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.730 [2024-04-26 01:07:42.886377] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.730 [2024-04-26 01:07:42.896828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.730 qpair failed and we were unable to recover it. 00:33:35.730 [2024-04-26 01:07:42.906322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.730 [2024-04-26 01:07:42.906360] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.730 [2024-04-26 01:07:42.906373] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.730 [2024-04-26 01:07:42.906379] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.730 [2024-04-26 01:07:42.906384] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.730 [2024-04-26 01:07:42.916804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.730 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:42.926377] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:42.926411] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:42.926424] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:42.926430] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:42.926435] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:42.936737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:42.946387] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:42.946419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:42.946434] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:42.946440] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:42.946446] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:42.956985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:42.966534] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:42.966566] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:42.966579] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:42.966585] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:42.966590] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:42.977111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:42.986569] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:42.986602] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:42.986615] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:42.986621] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:42.986626] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:42.997066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:43.006707] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:43.006737] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:43.006750] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:43.006755] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:43.006761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:43.017130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:43.026670] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:43.026700] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:43.026712] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:43.026718] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:43.026724] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:43.037176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:43.046768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.997 [2024-04-26 01:07:43.046803] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.997 [2024-04-26 01:07:43.046816] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.997 [2024-04-26 01:07:43.046822] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.997 [2024-04-26 01:07:43.046827] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.997 [2024-04-26 01:07:43.057181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.997 qpair failed and we were unable to recover it. 00:33:35.997 [2024-04-26 01:07:43.066822] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.066857] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.066870] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.066876] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.066882] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.077236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.086862] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.086900] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.086913] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.086919] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.086925] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.097282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.106950] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.106980] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.106992] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.106998] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.107004] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.117458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.127077] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.127116] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.127129] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.127135] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.127141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.137278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.147022] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.147059] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.147071] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.147077] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.147083] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.157408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.167161] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.167196] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.167209] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.167215] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.167220] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:35.998 [2024-04-26 01:07:43.177497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:35.998 qpair failed and we were unable to recover it. 00:33:35.998 [2024-04-26 01:07:43.187156] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:35.998 [2024-04-26 01:07:43.187189] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:35.998 [2024-04-26 01:07:43.187202] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:35.998 [2024-04-26 01:07:43.187208] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:35.998 [2024-04-26 01:07:43.187213] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.197526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.207262] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.207297] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.207310] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.207316] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.207324] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.217731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.227388] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.227423] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.227436] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.227442] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.227448] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.237699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.247464] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.247504] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.247516] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.247523] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.247528] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.257806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.267492] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.267523] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.267536] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.267542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.267547] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.277945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.287598] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.287633] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.287646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.287652] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.287657] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.297960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.307543] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.307583] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.307596] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.307603] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.307608] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.317932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.327634] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.327666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.327679] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.327685] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.327690] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.337986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.347606] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.347641] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.347653] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.347660] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.347665] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.358243] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.367754] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.367789] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.367802] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.367808] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.367814] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.378173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.387764] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.387804] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.387821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.387827] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.387833] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.398110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.407930] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.258 [2024-04-26 01:07:43.407966] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.258 [2024-04-26 01:07:43.407978] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.258 [2024-04-26 01:07:43.407984] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.258 [2024-04-26 01:07:43.407990] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.258 [2024-04-26 01:07:43.418279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.258 qpair failed and we were unable to recover it. 00:33:36.258 [2024-04-26 01:07:43.427942] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.259 [2024-04-26 01:07:43.427971] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.259 [2024-04-26 01:07:43.427984] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.259 [2024-04-26 01:07:43.427990] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.259 [2024-04-26 01:07:43.427995] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.259 [2024-04-26 01:07:43.438342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.259 qpair failed and we were unable to recover it. 00:33:36.259 [2024-04-26 01:07:43.447977] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.259 [2024-04-26 01:07:43.448011] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.259 [2024-04-26 01:07:43.448023] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.259 [2024-04-26 01:07:43.448029] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.259 [2024-04-26 01:07:43.448035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.458377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.468030] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.519 [2024-04-26 01:07:43.468069] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.519 [2024-04-26 01:07:43.468082] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.519 [2024-04-26 01:07:43.468088] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.519 [2024-04-26 01:07:43.468093] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.478504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.488139] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.519 [2024-04-26 01:07:43.488168] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.519 [2024-04-26 01:07:43.488181] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.519 [2024-04-26 01:07:43.488187] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.519 [2024-04-26 01:07:43.488192] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.498600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.508162] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.519 [2024-04-26 01:07:43.508192] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.519 [2024-04-26 01:07:43.508205] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.519 [2024-04-26 01:07:43.508211] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.519 [2024-04-26 01:07:43.508216] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.518501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.528258] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.519 [2024-04-26 01:07:43.528293] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.519 [2024-04-26 01:07:43.528305] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.519 [2024-04-26 01:07:43.528311] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.519 [2024-04-26 01:07:43.528317] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.538606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.548302] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.519 [2024-04-26 01:07:43.548338] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.519 [2024-04-26 01:07:43.548351] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.519 [2024-04-26 01:07:43.548357] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.519 [2024-04-26 01:07:43.548363] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.519 [2024-04-26 01:07:43.558615] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.519 qpair failed and we were unable to recover it. 00:33:36.519 [2024-04-26 01:07:43.568333] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.568372] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.568385] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.568391] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.568396] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.578909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.588537] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.588575] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.588589] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.588597] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.588603] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.598837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.608584] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.608618] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.608630] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.608636] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.608642] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.618890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.628590] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.628621] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.628633] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.628639] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.628645] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.638953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.648595] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.648633] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.648646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.648653] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.648660] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.658832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.668621] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.668655] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.668667] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.668673] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.668679] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.679177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:36.520 [2024-04-26 01:07:43.688651] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:36.520 [2024-04-26 01:07:43.688685] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:36.520 [2024-04-26 01:07:43.688698] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:36.520 [2024-04-26 01:07:43.688704] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:36.520 [2024-04-26 01:07:43.688709] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:36.520 [2024-04-26 01:07:43.698953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:36.520 qpair failed and we were unable to recover it. 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Write completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 Read completed with error (sct=0, sc=8) 00:33:37.901 starting I/O failed 00:33:37.901 [2024-04-26 01:07:44.704136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:37.901 [2024-04-26 01:07:44.711347] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.901 [2024-04-26 01:07:44.711384] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.901 [2024-04-26 01:07:44.711401] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.901 [2024-04-26 01:07:44.711408] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.901 [2024-04-26 01:07:44.711414] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:37.901 [2024-04-26 01:07:44.721939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:37.901 qpair failed and we were unable to recover it. 00:33:37.901 [2024-04-26 01:07:44.731704] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:37.901 [2024-04-26 01:07:44.731740] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:37.901 [2024-04-26 01:07:44.731756] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:37.901 [2024-04-26 01:07:44.731762] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:37.901 [2024-04-26 01:07:44.731768] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:33:37.901 [2024-04-26 01:07:44.741963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:37.901 qpair failed and we were unable to recover it. 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Write completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 Read completed with error (sct=0, sc=8) 00:33:38.840 starting I/O failed 00:33:38.840 [2024-04-26 01:07:45.746905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:38.840 [2024-04-26 01:07:45.754565] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.840 [2024-04-26 01:07:45.754605] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.840 [2024-04-26 01:07:45.754621] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.840 [2024-04-26 01:07:45.754628] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.840 [2024-04-26 01:07:45.754634] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:33:38.840 [2024-04-26 01:07:45.765378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:38.840 qpair failed and we were unable to recover it. 00:33:38.840 [2024-04-26 01:07:45.774789] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.840 [2024-04-26 01:07:45.774828] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.840 [2024-04-26 01:07:45.774841] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.840 [2024-04-26 01:07:45.774848] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.840 [2024-04-26 01:07:45.774854] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d15c0 00:33:38.840 [2024-04-26 01:07:45.785030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:38.840 qpair failed and we were unable to recover it. 00:33:38.840 [2024-04-26 01:07:45.785149] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:33:38.840 A controller has encountered a failure and is being reset. 00:33:38.840 [2024-04-26 01:07:45.794903] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.840 [2024-04-26 01:07:45.794947] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.840 [2024-04-26 01:07:45.794969] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.840 [2024-04-26 01:07:45.794978] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.840 [2024-04-26 01:07:45.794986] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:38.840 [2024-04-26 01:07:45.805244] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:38.840 qpair failed and we were unable to recover it. 00:33:38.840 [2024-04-26 01:07:45.814836] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:33:38.840 [2024-04-26 01:07:45.814874] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:33:38.840 [2024-04-26 01:07:45.814888] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:33:38.840 [2024-04-26 01:07:45.814894] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:33:38.840 [2024-04-26 01:07:45.814900] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:33:38.840 [2024-04-26 01:07:45.825143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:38.840 qpair failed and we were unable to recover it. 00:33:38.840 [2024-04-26 01:07:45.825307] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:38.840 [2024-04-26 01:07:45.857789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:38.840 Controller properly reset. 00:33:38.840 Initializing NVMe Controllers 00:33:38.840 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:38.840 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:38.840 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:33:38.840 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:33:38.840 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:33:38.840 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:33:38.840 Initialization complete. Launching workers. 00:33:38.840 Starting thread on core 1 00:33:38.840 Starting thread on core 2 00:33:38.840 Starting thread on core 3 00:33:38.840 Starting thread on core 0 00:33:38.840 01:07:45 -- host/target_disconnect.sh@59 -- # sync 00:33:38.840 00:33:38.840 real 0m13.462s 00:33:38.840 user 0m28.385s 00:33:38.840 sys 0m2.357s 00:33:38.840 01:07:45 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:38.840 01:07:45 -- common/autotest_common.sh@10 -- # set +x 00:33:38.840 ************************************ 00:33:38.840 END TEST nvmf_target_disconnect_tc2 00:33:38.840 ************************************ 00:33:38.840 01:07:45 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:33:38.840 01:07:45 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:33:38.840 01:07:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:33:38.840 01:07:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:38.840 01:07:45 -- common/autotest_common.sh@10 -- # set +x 00:33:39.100 ************************************ 00:33:39.100 START TEST nvmf_target_disconnect_tc3 00:33:39.100 ************************************ 00:33:39.100 01:07:46 -- common/autotest_common.sh@1111 -- # nvmf_target_disconnect_tc3 00:33:39.100 01:07:46 -- host/target_disconnect.sh@65 -- # reconnectpid=538603 00:33:39.100 01:07:46 -- host/target_disconnect.sh@67 -- # sleep 2 00:33:39.100 01:07:46 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:33:39.100 EAL: No free 2048 kB hugepages reported on node 1 00:33:41.005 01:07:48 -- host/target_disconnect.sh@68 -- # kill -9 537005 00:33:41.005 01:07:48 -- host/target_disconnect.sh@70 -- # sleep 2 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Read completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.383 Write completed with error (sct=0, sc=8) 00:33:42.383 starting I/O failed 00:33:42.384 Read completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Write completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Read completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Write completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Read completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Write completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Write completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Write completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 Read completed with error (sct=0, sc=8) 00:33:42.384 starting I/O failed 00:33:42.384 [2024-04-26 01:07:49.221462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:33:42.951 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 537005 Killed "${NVMF_APP[@]}" "$@" 00:33:42.951 01:07:50 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:33:42.951 01:07:50 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:33:42.951 01:07:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:33:42.951 01:07:50 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:42.951 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:33:42.951 01:07:50 -- nvmf/common.sh@470 -- # nvmfpid=539260 00:33:42.951 01:07:50 -- nvmf/common.sh@471 -- # waitforlisten 539260 00:33:42.951 01:07:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:33:42.951 01:07:50 -- common/autotest_common.sh@817 -- # '[' -z 539260 ']' 00:33:42.951 01:07:50 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:42.951 01:07:50 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:42.952 01:07:50 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:42.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:42.952 01:07:50 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:42.952 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:33:42.952 [2024-04-26 01:07:50.122961] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:42.952 [2024-04-26 01:07:50.123010] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:33:43.210 EAL: No free 2048 kB hugepages reported on node 1 00:33:43.210 [2024-04-26 01:07:50.190204] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:33:43.210 Read completed with error (sct=0, sc=8) 00:33:43.210 starting I/O failed 00:33:43.210 Write completed with error (sct=0, sc=8) 00:33:43.210 starting I/O failed 00:33:43.210 Write completed with error (sct=0, sc=8) 00:33:43.210 starting I/O failed 00:33:43.210 Read completed with error (sct=0, sc=8) 00:33:43.210 starting I/O failed 00:33:43.210 Read completed with error (sct=0, sc=8) 00:33:43.210 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Read completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 Write completed with error (sct=0, sc=8) 00:33:43.211 starting I/O failed 00:33:43.211 [2024-04-26 01:07:50.226360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:43.211 [2024-04-26 01:07:50.256739] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:33:43.211 [2024-04-26 01:07:50.256775] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:33:43.211 [2024-04-26 01:07:50.256782] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:33:43.211 [2024-04-26 01:07:50.256787] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:33:43.211 [2024-04-26 01:07:50.256792] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:33:43.211 [2024-04-26 01:07:50.256904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:33:43.211 [2024-04-26 01:07:50.257015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:33:43.211 [2024-04-26 01:07:50.257121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:33:43.211 [2024-04-26 01:07:50.257122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:33:43.779 01:07:50 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:43.779 01:07:50 -- common/autotest_common.sh@850 -- # return 0 00:33:43.779 01:07:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:33:43.779 01:07:50 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:43.779 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:33:43.779 01:07:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:33:43.779 01:07:50 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:33:43.779 01:07:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:43.779 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:33:43.779 Malloc0 00:33:43.779 01:07:50 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:43.779 01:07:50 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:33:43.779 01:07:50 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:43.779 01:07:50 -- common/autotest_common.sh@10 -- # set +x 00:33:44.039 [2024-04-26 01:07:50.982754] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1eae930/0x1eba540) succeed. 00:33:44.039 [2024-04-26 01:07:50.992193] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1eaff70/0x1f5a5d0) succeed. 00:33:44.039 01:07:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:44.039 01:07:51 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:33:44.039 01:07:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:44.039 01:07:51 -- common/autotest_common.sh@10 -- # set +x 00:33:44.039 01:07:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:44.039 01:07:51 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:33:44.039 01:07:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:44.039 01:07:51 -- common/autotest_common.sh@10 -- # set +x 00:33:44.039 01:07:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:44.039 01:07:51 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:33:44.039 01:07:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:44.039 01:07:51 -- common/autotest_common.sh@10 -- # set +x 00:33:44.039 [2024-04-26 01:07:51.118578] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:33:44.039 01:07:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:44.039 01:07:51 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:33:44.039 01:07:51 -- common/autotest_common.sh@549 -- # xtrace_disable 00:33:44.039 01:07:51 -- common/autotest_common.sh@10 -- # set +x 00:33:44.039 01:07:51 -- common/autotest_common.sh@577 -- # [[ 0 == 0 ]] 00:33:44.039 01:07:51 -- host/target_disconnect.sh@73 -- # wait 538603 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Read completed with error (sct=0, sc=8) 00:33:44.039 starting I/O failed 00:33:44.039 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Read completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Read completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Read completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 Write completed with error (sct=0, sc=8) 00:33:44.040 starting I/O failed 00:33:44.040 [2024-04-26 01:07:51.231380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Write completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Read completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.417 Write completed with error (sct=0, sc=8) 00:33:45.417 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Read completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 Write completed with error (sct=0, sc=8) 00:33:45.418 starting I/O failed 00:33:45.418 [2024-04-26 01:07:52.236206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:45.418 [2024-04-26 01:07:52.237693] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:45.418 [2024-04-26 01:07:52.237711] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:45.418 [2024-04-26 01:07:52.237717] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:46.352 [2024-04-26 01:07:53.241608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:46.352 qpair failed and we were unable to recover it. 00:33:46.352 [2024-04-26 01:07:53.242966] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:46.352 [2024-04-26 01:07:53.242979] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:46.352 [2024-04-26 01:07:53.242985] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:47.288 [2024-04-26 01:07:54.246769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:47.288 qpair failed and we were unable to recover it. 00:33:47.288 [2024-04-26 01:07:54.248218] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:47.288 [2024-04-26 01:07:54.248231] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:47.288 [2024-04-26 01:07:54.248236] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:48.224 [2024-04-26 01:07:55.252083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:48.224 qpair failed and we were unable to recover it. 00:33:48.224 [2024-04-26 01:07:55.253332] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:48.224 [2024-04-26 01:07:55.253345] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:48.224 [2024-04-26 01:07:55.253351] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:49.161 [2024-04-26 01:07:56.257070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:49.161 qpair failed and we were unable to recover it. 00:33:49.161 [2024-04-26 01:07:56.258306] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:49.161 [2024-04-26 01:07:56.258319] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:49.161 [2024-04-26 01:07:56.258325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:50.096 [2024-04-26 01:07:57.262058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:50.096 qpair failed and we were unable to recover it. 00:33:50.096 [2024-04-26 01:07:57.263382] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:50.096 [2024-04-26 01:07:57.263395] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:50.096 [2024-04-26 01:07:57.263400] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:33:51.472 [2024-04-26 01:07:58.267260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:33:51.472 qpair failed and we were unable to recover it. 00:33:51.472 [2024-04-26 01:07:58.268684] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:51.472 [2024-04-26 01:07:58.268703] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:51.472 [2024-04-26 01:07:58.268709] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:52.407 [2024-04-26 01:07:59.272404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:52.407 qpair failed and we were unable to recover it. 00:33:52.407 [2024-04-26 01:07:59.273745] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:33:52.407 [2024-04-26 01:07:59.273759] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:33:52.407 [2024-04-26 01:07:59.273765] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:33:53.344 [2024-04-26 01:08:00.277577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:33:53.344 qpair failed and we were unable to recover it. 00:33:53.344 [2024-04-26 01:08:00.277703] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:33:53.344 A controller has encountered a failure and is being reset. 00:33:53.344 Resorting to new failover address 192.168.100.9 00:33:53.344 [2024-04-26 01:08:00.277795] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:33:53.344 [2024-04-26 01:08:00.277853] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:33:53.344 [2024-04-26 01:08:00.308772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:33:53.344 Controller properly reset. 00:33:53.344 Initializing NVMe Controllers 00:33:53.344 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:53.344 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:33:53.344 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:33:53.344 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:33:53.344 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:33:53.344 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:33:53.344 Initialization complete. Launching workers. 00:33:53.344 Starting thread on core 1 00:33:53.344 Starting thread on core 2 00:33:53.344 Starting thread on core 3 00:33:53.344 Starting thread on core 0 00:33:53.344 01:08:00 -- host/target_disconnect.sh@74 -- # sync 00:33:53.344 00:33:53.344 real 0m14.319s 00:33:53.344 user 0m58.245s 00:33:53.344 sys 0m3.117s 00:33:53.344 01:08:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:53.344 01:08:00 -- common/autotest_common.sh@10 -- # set +x 00:33:53.344 ************************************ 00:33:53.344 END TEST nvmf_target_disconnect_tc3 00:33:53.344 ************************************ 00:33:53.344 01:08:00 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:33:53.344 01:08:00 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:33:53.344 01:08:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:33:53.344 01:08:00 -- nvmf/common.sh@117 -- # sync 00:33:53.344 01:08:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:33:53.344 01:08:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:33:53.344 01:08:00 -- nvmf/common.sh@120 -- # set +e 00:33:53.344 01:08:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:33:53.344 01:08:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:33:53.344 rmmod nvme_rdma 00:33:53.344 rmmod nvme_fabrics 00:33:53.344 01:08:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:33:53.344 01:08:00 -- nvmf/common.sh@124 -- # set -e 00:33:53.344 01:08:00 -- nvmf/common.sh@125 -- # return 0 00:33:53.344 01:08:00 -- nvmf/common.sh@478 -- # '[' -n 539260 ']' 00:33:53.344 01:08:00 -- nvmf/common.sh@479 -- # killprocess 539260 00:33:53.344 01:08:00 -- common/autotest_common.sh@936 -- # '[' -z 539260 ']' 00:33:53.344 01:08:00 -- common/autotest_common.sh@940 -- # kill -0 539260 00:33:53.344 01:08:00 -- common/autotest_common.sh@941 -- # uname 00:33:53.344 01:08:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:33:53.344 01:08:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 539260 00:33:53.344 01:08:00 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:33:53.344 01:08:00 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:33:53.344 01:08:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 539260' 00:33:53.344 killing process with pid 539260 00:33:53.344 01:08:00 -- common/autotest_common.sh@955 -- # kill 539260 00:33:53.344 01:08:00 -- common/autotest_common.sh@960 -- # wait 539260 00:33:53.602 [2024-04-26 01:08:00.592091] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:33:53.861 01:08:00 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:33:53.861 01:08:00 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:33:53.861 00:33:53.861 real 0m34.902s 00:33:53.861 user 2m10.881s 00:33:53.861 sys 0m9.935s 00:33:53.862 01:08:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:53.862 01:08:00 -- common/autotest_common.sh@10 -- # set +x 00:33:53.862 ************************************ 00:33:53.862 END TEST nvmf_target_disconnect 00:33:53.862 ************************************ 00:33:53.862 01:08:00 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:33:53.862 01:08:00 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:53.862 01:08:00 -- common/autotest_common.sh@10 -- # set +x 00:33:53.862 01:08:00 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:33:53.862 00:33:53.862 real 25m42.607s 00:33:53.862 user 79m58.422s 00:33:53.862 sys 4m46.763s 00:33:53.862 01:08:00 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:33:53.862 01:08:00 -- common/autotest_common.sh@10 -- # set +x 00:33:53.862 ************************************ 00:33:53.862 END TEST nvmf_rdma 00:33:53.862 ************************************ 00:33:53.862 01:08:00 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:33:53.862 01:08:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:33:53.862 01:08:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:33:53.862 01:08:00 -- common/autotest_common.sh@10 -- # set +x 00:33:53.862 ************************************ 00:33:53.862 START TEST spdkcli_nvmf_rdma 00:33:53.862 ************************************ 00:33:53.862 01:08:01 -- common/autotest_common.sh@1111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:33:54.121 * Looking for test storage... 00:33:54.121 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:33:54.121 01:08:01 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:33:54.121 01:08:01 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:33:54.121 01:08:01 -- nvmf/common.sh@7 -- # uname -s 00:33:54.121 01:08:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:33:54.121 01:08:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:33:54.121 01:08:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:33:54.121 01:08:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:33:54.121 01:08:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:33:54.121 01:08:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:33:54.121 01:08:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:33:54.121 01:08:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:33:54.121 01:08:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:33:54.121 01:08:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:33:54.121 01:08:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:00bafac1-9c9c-e711-906e-0017a4403562 00:33:54.121 01:08:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=00bafac1-9c9c-e711-906e-0017a4403562 00:33:54.121 01:08:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:33:54.121 01:08:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:33:54.121 01:08:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:33:54.121 01:08:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:33:54.121 01:08:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:33:54.121 01:08:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:33:54.121 01:08:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:54.121 01:08:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:54.121 01:08:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:54.121 01:08:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:54.121 01:08:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:54.121 01:08:01 -- paths/export.sh@5 -- # export PATH 00:33:54.121 01:08:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:54.121 01:08:01 -- nvmf/common.sh@47 -- # : 0 00:33:54.121 01:08:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:33:54.121 01:08:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:33:54.121 01:08:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:33:54.121 01:08:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:33:54.121 01:08:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:33:54.121 01:08:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:33:54.121 01:08:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:33:54.121 01:08:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:33:54.121 01:08:01 -- common/autotest_common.sh@710 -- # xtrace_disable 00:33:54.121 01:08:01 -- common/autotest_common.sh@10 -- # set +x 00:33:54.121 01:08:01 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:33:54.121 01:08:01 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=541348 00:33:54.121 01:08:01 -- spdkcli/common.sh@34 -- # waitforlisten 541348 00:33:54.121 01:08:01 -- common/autotest_common.sh@817 -- # '[' -z 541348 ']' 00:33:54.121 01:08:01 -- common/autotest_common.sh@821 -- # local rpc_addr=/var/tmp/spdk.sock 00:33:54.121 01:08:01 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:33:54.121 01:08:01 -- common/autotest_common.sh@822 -- # local max_retries=100 00:33:54.121 01:08:01 -- common/autotest_common.sh@824 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:33:54.121 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:33:54.121 01:08:01 -- common/autotest_common.sh@826 -- # xtrace_disable 00:33:54.121 01:08:01 -- common/autotest_common.sh@10 -- # set +x 00:33:54.121 [2024-04-26 01:08:01.212526] Starting SPDK v24.05-pre git sha1 06472fb6d / DPDK 23.11.0 initialization... 00:33:54.121 [2024-04-26 01:08:01.212571] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid541348 ] 00:33:54.121 EAL: No free 2048 kB hugepages reported on node 1 00:33:54.121 [2024-04-26 01:08:01.262773] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:33:54.380 [2024-04-26 01:08:01.335586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:33:54.380 [2024-04-26 01:08:01.335588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:33:54.947 01:08:01 -- common/autotest_common.sh@846 -- # (( i == 0 )) 00:33:54.947 01:08:01 -- common/autotest_common.sh@850 -- # return 0 00:33:54.948 01:08:01 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:33:54.948 01:08:01 -- common/autotest_common.sh@716 -- # xtrace_disable 00:33:54.948 01:08:01 -- common/autotest_common.sh@10 -- # set +x 00:33:54.948 01:08:02 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:33:54.948 01:08:02 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:33:54.948 01:08:02 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:33:54.948 01:08:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:33:54.948 01:08:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:33:54.948 01:08:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:33:54.948 01:08:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:33:54.948 01:08:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:33:54.948 01:08:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:54.948 01:08:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:54.948 01:08:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:54.948 01:08:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:33:54.948 01:08:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:33:54.948 01:08:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:33:54.948 01:08:02 -- common/autotest_common.sh@10 -- # set +x 00:34:00.220 01:08:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:34:00.220 01:08:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:34:00.220 01:08:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:34:00.220 01:08:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:34:00.220 01:08:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:34:00.220 01:08:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:34:00.220 01:08:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:34:00.220 01:08:07 -- nvmf/common.sh@295 -- # net_devs=() 00:34:00.220 01:08:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:34:00.220 01:08:07 -- nvmf/common.sh@296 -- # e810=() 00:34:00.220 01:08:07 -- nvmf/common.sh@296 -- # local -ga e810 00:34:00.220 01:08:07 -- nvmf/common.sh@297 -- # x722=() 00:34:00.220 01:08:07 -- nvmf/common.sh@297 -- # local -ga x722 00:34:00.220 01:08:07 -- nvmf/common.sh@298 -- # mlx=() 00:34:00.220 01:08:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:34:00.220 01:08:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:34:00.220 01:08:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:34:00.220 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:34:00.220 01:08:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:34:00.220 01:08:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:34:00.220 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:34:00.220 01:08:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:34:00.220 01:08:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:00.220 01:08:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:00.220 01:08:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:34:00.220 Found net devices under 0000:18:00.0: mlx_0_0 00:34:00.220 01:08:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:34:00.220 01:08:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:34:00.220 01:08:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:34:00.220 Found net devices under 0000:18:00.1: mlx_0_1 00:34:00.220 01:08:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:34:00.220 01:08:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:34:00.220 01:08:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:34:00.220 01:08:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:34:00.220 01:08:07 -- nvmf/common.sh@58 -- # uname 00:34:00.220 01:08:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:34:00.220 01:08:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:34:00.220 01:08:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:34:00.220 01:08:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:34:00.220 01:08:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:34:00.220 01:08:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:34:00.220 01:08:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:34:00.220 01:08:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:34:00.220 01:08:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:34:00.220 01:08:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:34:00.220 01:08:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:34:00.220 01:08:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:34:00.220 01:08:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:34:00.220 01:08:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:34:00.220 01:08:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:34:00.220 01:08:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:34:00.220 01:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:34:00.220 01:08:07 -- nvmf/common.sh@105 -- # continue 2 00:34:00.220 01:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.220 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:34:00.220 01:08:07 -- nvmf/common.sh@105 -- # continue 2 00:34:00.220 01:08:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:34:00.220 01:08:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:34:00.220 01:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:34:00.220 01:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:34:00.220 01:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:00.220 01:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:00.220 01:08:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:34:00.220 01:08:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:34:00.220 01:08:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:34:00.220 8: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:34:00.220 link/ether 50:6b:4b:b4:ac:7a brd ff:ff:ff:ff:ff:ff 00:34:00.220 altname enp24s0f0np0 00:34:00.220 altname ens785f0np0 00:34:00.220 inet 192.168.100.8/24 scope global mlx_0_0 00:34:00.220 valid_lft forever preferred_lft forever 00:34:00.220 01:08:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:34:00.221 01:08:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:34:00.221 01:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:34:00.221 01:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:34:00.221 01:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:00.221 01:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:00.221 01:08:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:34:00.221 01:08:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:34:00.221 01:08:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:34:00.221 9: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:34:00.221 link/ether 50:6b:4b:b4:ac:7b brd ff:ff:ff:ff:ff:ff 00:34:00.221 altname enp24s0f1np1 00:34:00.221 altname ens785f1np1 00:34:00.221 inet 192.168.100.9/24 scope global mlx_0_1 00:34:00.221 valid_lft forever preferred_lft forever 00:34:00.221 01:08:07 -- nvmf/common.sh@411 -- # return 0 00:34:00.221 01:08:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:34:00.221 01:08:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:34:00.221 01:08:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:34:00.221 01:08:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:34:00.221 01:08:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:34:00.221 01:08:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:34:00.221 01:08:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:34:00.221 01:08:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:34:00.221 01:08:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:34:00.481 01:08:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:34:00.481 01:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:00.481 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.481 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:34:00.481 01:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:34:00.481 01:08:07 -- nvmf/common.sh@105 -- # continue 2 00:34:00.481 01:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:34:00.481 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.481 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:34:00.481 01:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:34:00.481 01:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:34:00.481 01:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:34:00.481 01:08:07 -- nvmf/common.sh@105 -- # continue 2 00:34:00.481 01:08:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:34:00.481 01:08:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:34:00.481 01:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:00.481 01:08:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:34:00.481 01:08:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:34:00.481 01:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:34:00.481 01:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:34:00.481 01:08:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:34:00.481 192.168.100.9' 00:34:00.481 01:08:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:34:00.481 192.168.100.9' 00:34:00.481 01:08:07 -- nvmf/common.sh@446 -- # head -n 1 00:34:00.481 01:08:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:34:00.481 01:08:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:34:00.481 192.168.100.9' 00:34:00.481 01:08:07 -- nvmf/common.sh@447 -- # tail -n +2 00:34:00.481 01:08:07 -- nvmf/common.sh@447 -- # head -n 1 00:34:00.481 01:08:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:34:00.481 01:08:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:34:00.481 01:08:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:34:00.481 01:08:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:34:00.481 01:08:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:34:00.481 01:08:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:34:00.481 01:08:07 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:34:00.481 01:08:07 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:34:00.481 01:08:07 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:00.481 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:34:00.481 01:08:07 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:34:00.481 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:34:00.481 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:34:00.481 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:34:00.481 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:34:00.481 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:34:00.481 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:34:00.481 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:00.481 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:00.481 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:34:00.481 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:34:00.482 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:34:00.482 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:34:00.482 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:34:00.482 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:34:00.482 ' 00:34:00.741 [2024-04-26 01:08:07.863914] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:34:03.288 [2024-04-26 01:08:09.900409] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x244f120/0x257f200) succeed. 00:34:03.288 [2024-04-26 01:08:09.910801] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2450800/0x245f080) succeed. 00:34:03.949 [2024-04-26 01:08:11.133143] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:34:06.554 [2024-04-26 01:08:13.279706] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:34:08.047 [2024-04-26 01:08:15.133558] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:34:09.535 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:34:09.535 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:34:09.535 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:09.535 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:09.535 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:34:09.535 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:34:09.535 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:34:09.535 01:08:16 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:34:09.535 01:08:16 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:09.535 01:08:16 -- common/autotest_common.sh@10 -- # set +x 00:34:09.535 01:08:16 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:34:09.535 01:08:16 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:09.535 01:08:16 -- common/autotest_common.sh@10 -- # set +x 00:34:09.535 01:08:16 -- spdkcli/nvmf.sh@69 -- # check_match 00:34:09.535 01:08:16 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:34:10.107 01:08:17 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:34:10.107 01:08:17 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:34:10.107 01:08:17 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:34:10.107 01:08:17 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:10.107 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:34:10.107 01:08:17 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:34:10.107 01:08:17 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:10.107 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:34:10.107 01:08:17 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:34:10.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:34:10.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:34:10.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:34:10.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:34:10.107 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:34:10.107 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:34:10.107 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:34:10.107 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:34:10.107 ' 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:34:15.383 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:34:15.383 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:34:15.383 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:34:15.383 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:34:15.383 01:08:22 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:34:15.383 01:08:22 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:15.383 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:34:15.383 01:08:22 -- spdkcli/nvmf.sh@90 -- # killprocess 541348 00:34:15.383 01:08:22 -- common/autotest_common.sh@936 -- # '[' -z 541348 ']' 00:34:15.383 01:08:22 -- common/autotest_common.sh@940 -- # kill -0 541348 00:34:15.383 01:08:22 -- common/autotest_common.sh@941 -- # uname 00:34:15.383 01:08:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:34:15.383 01:08:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 541348 00:34:15.383 01:08:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:34:15.383 01:08:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:34:15.383 01:08:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 541348' 00:34:15.383 killing process with pid 541348 00:34:15.383 01:08:22 -- common/autotest_common.sh@955 -- # kill 541348 00:34:15.383 [2024-04-26 01:08:22.101523] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:34:15.383 01:08:22 -- common/autotest_common.sh@960 -- # wait 541348 00:34:15.383 [2024-04-26 01:08:22.149427] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:34:15.383 01:08:22 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:34:15.383 01:08:22 -- nvmf/common.sh@477 -- # nvmfcleanup 00:34:15.383 01:08:22 -- nvmf/common.sh@117 -- # sync 00:34:15.383 01:08:22 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:34:15.383 01:08:22 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:34:15.383 01:08:22 -- nvmf/common.sh@120 -- # set +e 00:34:15.383 01:08:22 -- nvmf/common.sh@121 -- # for i in {1..20} 00:34:15.383 01:08:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:34:15.383 rmmod nvme_rdma 00:34:15.383 rmmod nvme_fabrics 00:34:15.383 01:08:22 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:34:15.383 01:08:22 -- nvmf/common.sh@124 -- # set -e 00:34:15.383 01:08:22 -- nvmf/common.sh@125 -- # return 0 00:34:15.383 01:08:22 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:34:15.383 01:08:22 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:34:15.383 01:08:22 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:34:15.383 00:34:15.383 real 0m21.356s 00:34:15.383 user 0m44.973s 00:34:15.383 sys 0m4.867s 00:34:15.383 01:08:22 -- common/autotest_common.sh@1112 -- # xtrace_disable 00:34:15.383 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:34:15.383 ************************************ 00:34:15.383 END TEST spdkcli_nvmf_rdma 00:34:15.383 ************************************ 00:34:15.383 01:08:22 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:34:15.383 01:08:22 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:34:15.383 01:08:22 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:34:15.383 01:08:22 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:34:15.383 01:08:22 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:34:15.383 01:08:22 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:34:15.383 01:08:22 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:34:15.383 01:08:22 -- common/autotest_common.sh@710 -- # xtrace_disable 00:34:15.383 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:34:15.383 01:08:22 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:34:15.383 01:08:22 -- common/autotest_common.sh@1378 -- # local autotest_es=0 00:34:15.383 01:08:22 -- common/autotest_common.sh@1379 -- # xtrace_disable 00:34:15.383 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:34:20.654 INFO: APP EXITING 00:34:20.654 INFO: killing all VMs 00:34:20.654 INFO: killing vhost app 00:34:20.654 INFO: EXIT DONE 00:34:22.031 Waiting for block devices as requested 00:34:22.031 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:22.291 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:22.291 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:22.291 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:22.291 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:22.549 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:22.549 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:22.549 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:22.550 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:34:22.809 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:34:22.809 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:34:22.809 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:34:22.809 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:34:23.069 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:34:23.069 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:34:23.069 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:34:23.328 0000:d8:00.0 (8086 0a54): vfio-pci -> nvme 00:34:27.521 Cleaning 00:34:27.521 Removing: /var/run/dpdk/spdk0/config 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:34:27.521 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:34:27.521 Removing: /var/run/dpdk/spdk0/hugepage_info 00:34:27.521 Removing: /var/run/dpdk/spdk1/config 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:34:27.521 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:34:27.521 Removing: /var/run/dpdk/spdk1/hugepage_info 00:34:27.521 Removing: /var/run/dpdk/spdk1/mp_socket 00:34:27.521 Removing: /var/run/dpdk/spdk2/config 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:34:27.521 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:34:27.521 Removing: /var/run/dpdk/spdk2/hugepage_info 00:34:27.521 Removing: /var/run/dpdk/spdk3/config 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:34:27.521 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:34:27.521 Removing: /var/run/dpdk/spdk3/hugepage_info 00:34:27.521 Removing: /var/run/dpdk/spdk4/config 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:34:27.521 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:34:27.521 Removing: /var/run/dpdk/spdk4/hugepage_info 00:34:27.521 Removing: /dev/shm/bdevperf_trace.pid298847 00:34:27.521 Removing: /dev/shm/bdevperf_trace.pid439254 00:34:27.521 Removing: /dev/shm/bdev_svc_trace.1 00:34:27.521 Removing: /dev/shm/nvmf_trace.0 00:34:27.521 Removing: /dev/shm/spdk_tgt_trace.pid127974 00:34:27.521 Removing: /var/run/dpdk/spdk0 00:34:27.521 Removing: /var/run/dpdk/spdk1 00:34:27.521 Removing: /var/run/dpdk/spdk2 00:34:27.521 Removing: /var/run/dpdk/spdk3 00:34:27.521 Removing: /var/run/dpdk/spdk4 00:34:27.521 Removing: /var/run/dpdk/spdk_pid124515 00:34:27.521 Removing: /var/run/dpdk/spdk_pid126178 00:34:27.521 Removing: /var/run/dpdk/spdk_pid127974 00:34:27.521 Removing: /var/run/dpdk/spdk_pid128840 00:34:27.521 Removing: /var/run/dpdk/spdk_pid129817 00:34:27.521 Removing: /var/run/dpdk/spdk_pid130033 00:34:27.521 Removing: /var/run/dpdk/spdk_pid131173 00:34:27.521 Removing: /var/run/dpdk/spdk_pid131390 00:34:27.521 Removing: /var/run/dpdk/spdk_pid131772 00:34:27.521 Removing: /var/run/dpdk/spdk_pid136936 00:34:27.521 Removing: /var/run/dpdk/spdk_pid138889 00:34:27.521 Removing: /var/run/dpdk/spdk_pid139212 00:34:27.521 Removing: /var/run/dpdk/spdk_pid139537 00:34:27.521 Removing: /var/run/dpdk/spdk_pid139888 00:34:27.521 Removing: /var/run/dpdk/spdk_pid140223 00:34:27.521 Removing: /var/run/dpdk/spdk_pid140513 00:34:27.521 Removing: /var/run/dpdk/spdk_pid140800 00:34:27.521 Removing: /var/run/dpdk/spdk_pid141125 00:34:27.521 Removing: /var/run/dpdk/spdk_pid142231 00:34:27.521 Removing: /var/run/dpdk/spdk_pid145378 00:34:27.521 Removing: /var/run/dpdk/spdk_pid145703 00:34:27.521 Removing: /var/run/dpdk/spdk_pid146161 00:34:27.521 Removing: /var/run/dpdk/spdk_pid146229 00:34:27.521 Removing: /var/run/dpdk/spdk_pid146800 00:34:27.521 Removing: /var/run/dpdk/spdk_pid147055 00:34:27.521 Removing: /var/run/dpdk/spdk_pid147382 00:34:27.521 Removing: /var/run/dpdk/spdk_pid147632 00:34:27.521 Removing: /var/run/dpdk/spdk_pid147932 00:34:27.521 Removing: /var/run/dpdk/spdk_pid148195 00:34:27.521 Removing: /var/run/dpdk/spdk_pid148386 00:34:27.521 Removing: /var/run/dpdk/spdk_pid148507 00:34:27.521 Removing: /var/run/dpdk/spdk_pid149138 00:34:27.521 Removing: /var/run/dpdk/spdk_pid149429 00:34:27.521 Removing: /var/run/dpdk/spdk_pid149755 00:34:27.521 Removing: /var/run/dpdk/spdk_pid150073 00:34:27.521 Removing: /var/run/dpdk/spdk_pid150106 00:34:27.521 Removing: /var/run/dpdk/spdk_pid150438 00:34:27.521 Removing: /var/run/dpdk/spdk_pid150734 00:34:27.521 Removing: /var/run/dpdk/spdk_pid151021 00:34:27.521 Removing: /var/run/dpdk/spdk_pid151313 00:34:27.521 Removing: /var/run/dpdk/spdk_pid151600 00:34:27.521 Removing: /var/run/dpdk/spdk_pid151889 00:34:27.521 Removing: /var/run/dpdk/spdk_pid152177 00:34:27.521 Removing: /var/run/dpdk/spdk_pid152468 00:34:27.521 Removing: /var/run/dpdk/spdk_pid152762 00:34:27.521 Removing: /var/run/dpdk/spdk_pid153067 00:34:27.521 Removing: /var/run/dpdk/spdk_pid153390 00:34:27.521 Removing: /var/run/dpdk/spdk_pid153727 00:34:27.521 Removing: /var/run/dpdk/spdk_pid154161 00:34:27.521 Removing: /var/run/dpdk/spdk_pid154509 00:34:27.521 Removing: /var/run/dpdk/spdk_pid155043 00:34:27.521 Removing: /var/run/dpdk/spdk_pid155641 00:34:27.521 Removing: /var/run/dpdk/spdk_pid155943 00:34:27.521 Removing: /var/run/dpdk/spdk_pid156230 00:34:27.521 Removing: /var/run/dpdk/spdk_pid156529 00:34:27.521 Removing: /var/run/dpdk/spdk_pid156813 00:34:27.521 Removing: /var/run/dpdk/spdk_pid157108 00:34:27.521 Removing: /var/run/dpdk/spdk_pid157308 00:34:27.521 Removing: /var/run/dpdk/spdk_pid157780 00:34:27.521 Removing: /var/run/dpdk/spdk_pid161721 00:34:27.521 Removing: /var/run/dpdk/spdk_pid260251 00:34:27.521 Removing: /var/run/dpdk/spdk_pid264315 00:34:27.521 Removing: /var/run/dpdk/spdk_pid273689 00:34:27.521 Removing: /var/run/dpdk/spdk_pid279069 00:34:27.521 Removing: /var/run/dpdk/spdk_pid282599 00:34:27.521 Removing: /var/run/dpdk/spdk_pid283482 00:34:27.521 Removing: /var/run/dpdk/spdk_pid298847 00:34:27.521 Removing: /var/run/dpdk/spdk_pid299298 00:34:27.521 Removing: /var/run/dpdk/spdk_pid303388 00:34:27.521 Removing: /var/run/dpdk/spdk_pid309270 00:34:27.521 Removing: /var/run/dpdk/spdk_pid312025 00:34:27.521 Removing: /var/run/dpdk/spdk_pid322125 00:34:27.521 Removing: /var/run/dpdk/spdk_pid346920 00:34:27.521 Removing: /var/run/dpdk/spdk_pid350943 00:34:27.521 Removing: /var/run/dpdk/spdk_pid356416 00:34:27.521 Removing: /var/run/dpdk/spdk_pid391299 00:34:27.521 Removing: /var/run/dpdk/spdk_pid407984 00:34:27.521 Removing: /var/run/dpdk/spdk_pid437116 00:34:27.521 Removing: /var/run/dpdk/spdk_pid438151 00:34:27.521 Removing: /var/run/dpdk/spdk_pid439254 00:34:27.522 Removing: /var/run/dpdk/spdk_pid443546 00:34:27.522 Removing: /var/run/dpdk/spdk_pid450607 00:34:27.522 Removing: /var/run/dpdk/spdk_pid451479 00:34:27.522 Removing: /var/run/dpdk/spdk_pid452451 00:34:27.522 Removing: /var/run/dpdk/spdk_pid453493 00:34:27.522 Removing: /var/run/dpdk/spdk_pid453828 00:34:27.522 Removing: /var/run/dpdk/spdk_pid458330 00:34:27.522 Removing: /var/run/dpdk/spdk_pid458332 00:34:27.522 Removing: /var/run/dpdk/spdk_pid462767 00:34:27.522 Removing: /var/run/dpdk/spdk_pid463448 00:34:27.522 Removing: /var/run/dpdk/spdk_pid463993 00:34:27.522 Removing: /var/run/dpdk/spdk_pid464773 00:34:27.522 Removing: /var/run/dpdk/spdk_pid464778 00:34:27.522 Removing: /var/run/dpdk/spdk_pid468454 00:34:27.522 Removing: /var/run/dpdk/spdk_pid470794 00:34:27.522 Removing: /var/run/dpdk/spdk_pid472992 00:34:27.522 Removing: /var/run/dpdk/spdk_pid474971 00:34:27.522 Removing: /var/run/dpdk/spdk_pid476902 00:34:27.522 Removing: /var/run/dpdk/spdk_pid478938 00:34:27.522 Removing: /var/run/dpdk/spdk_pid485167 00:34:27.522 Removing: /var/run/dpdk/spdk_pid485830 00:34:27.522 Removing: /var/run/dpdk/spdk_pid488862 00:34:27.522 Removing: /var/run/dpdk/spdk_pid490083 00:34:27.522 Removing: /var/run/dpdk/spdk_pid499432 00:34:27.522 Removing: /var/run/dpdk/spdk_pid502378 00:34:27.522 Removing: /var/run/dpdk/spdk_pid509442 00:34:27.522 Removing: /var/run/dpdk/spdk_pid509445 00:34:27.522 Removing: /var/run/dpdk/spdk_pid529734 00:34:27.522 Removing: /var/run/dpdk/spdk_pid529998 00:34:27.780 Removing: /var/run/dpdk/spdk_pid535894 00:34:27.780 Removing: /var/run/dpdk/spdk_pid536361 00:34:27.780 Removing: /var/run/dpdk/spdk_pid538603 00:34:27.780 Removing: /var/run/dpdk/spdk_pid541348 00:34:27.780 Clean 00:34:27.780 01:08:34 -- common/autotest_common.sh@1437 -- # return 0 00:34:27.780 01:08:34 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:34:27.780 01:08:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:27.780 01:08:34 -- common/autotest_common.sh@10 -- # set +x 00:34:27.780 01:08:34 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:34:27.780 01:08:34 -- common/autotest_common.sh@716 -- # xtrace_disable 00:34:27.780 01:08:34 -- common/autotest_common.sh@10 -- # set +x 00:34:27.780 01:08:34 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:34:27.780 01:08:34 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:34:27.780 01:08:34 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:34:27.780 01:08:34 -- spdk/autotest.sh@389 -- # hash lcov 00:34:27.780 01:08:34 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:34:27.780 01:08:34 -- spdk/autotest.sh@391 -- # hostname 00:34:27.780 01:08:34 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-37 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:34:28.039 geninfo: WARNING: invalid characters removed from testname! 00:34:46.120 01:08:51 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:47.056 01:08:54 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:48.959 01:08:55 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:50.336 01:08:57 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:51.713 01:08:58 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:53.091 01:09:00 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:34:54.996 01:09:01 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:54.996 01:09:01 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:34:54.996 01:09:01 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:54.996 01:09:01 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:54.996 01:09:01 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:54.996 01:09:01 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:54.996 01:09:01 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:54.996 01:09:01 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:54.996 01:09:01 -- paths/export.sh@5 -- $ export PATH 00:34:54.996 01:09:01 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:54.996 01:09:01 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:34:54.996 01:09:01 -- common/autobuild_common.sh@435 -- $ date +%s 00:34:54.996 01:09:01 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714086541.XXXXXX 00:34:54.996 01:09:01 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714086541.grgY0h 00:34:54.996 01:09:01 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:34:54.996 01:09:01 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:34:54.996 01:09:01 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:34:54.996 01:09:01 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:54.996 01:09:01 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:54.996 01:09:01 -- common/autobuild_common.sh@451 -- $ get_config_params 00:34:54.996 01:09:01 -- common/autotest_common.sh@385 -- $ xtrace_disable 00:34:54.996 01:09:01 -- common/autotest_common.sh@10 -- $ set +x 00:34:54.996 01:09:01 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:34:54.996 01:09:01 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:34:54.996 01:09:01 -- pm/common@17 -- $ local monitor 00:34:54.996 01:09:01 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:54.996 01:09:01 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=557607 00:34:54.996 01:09:01 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:54.996 01:09:01 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=557609 00:34:54.996 01:09:01 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:54.996 01:09:01 -- pm/common@21 -- $ date +%s 00:34:54.996 01:09:01 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=557611 00:34:54.996 01:09:01 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:54.996 01:09:01 -- pm/common@21 -- $ date +%s 00:34:54.996 01:09:01 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=557614 00:34:54.996 01:09:01 -- pm/common@26 -- $ sleep 1 00:34:54.996 01:09:01 -- pm/common@21 -- $ date +%s 00:34:54.996 01:09:01 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714086541 00:34:54.996 01:09:01 -- pm/common@21 -- $ date +%s 00:34:54.996 01:09:01 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714086541 00:34:54.996 01:09:01 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714086541 00:34:54.996 01:09:01 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714086541 00:34:54.996 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714086541_collect-vmstat.pm.log 00:34:54.996 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714086541_collect-cpu-load.pm.log 00:34:54.997 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714086541_collect-bmc-pm.bmc.pm.log 00:34:54.997 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714086541_collect-cpu-temp.pm.log 00:34:55.934 01:09:02 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:34:55.934 01:09:02 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j112 00:34:55.934 01:09:02 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:55.934 01:09:02 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:55.934 01:09:02 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:55.934 01:09:02 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:55.934 01:09:02 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:55.934 01:09:02 -- common/autotest_common.sh@722 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:55.934 01:09:02 -- common/autotest_common.sh@723 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:55.934 01:09:02 -- common/autotest_common.sh@725 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:34:55.934 01:09:02 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:55.934 01:09:02 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:34:55.934 01:09:02 -- pm/common@30 -- $ signal_monitor_resources TERM 00:34:55.934 01:09:02 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:34:55.934 01:09:02 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:55.934 01:09:02 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:34:55.934 01:09:02 -- pm/common@45 -- $ pid=557620 00:34:55.934 01:09:02 -- pm/common@52 -- $ sudo kill -TERM 557620 00:34:55.934 01:09:02 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:55.934 01:09:02 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:34:55.934 01:09:02 -- pm/common@45 -- $ pid=557625 00:34:55.934 01:09:02 -- pm/common@52 -- $ sudo kill -TERM 557625 00:34:55.934 01:09:02 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:55.934 01:09:02 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:34:55.934 01:09:02 -- pm/common@45 -- $ pid=557624 00:34:55.934 01:09:02 -- pm/common@52 -- $ sudo kill -TERM 557624 00:34:55.934 01:09:02 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:34:55.934 01:09:02 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:34:55.934 01:09:02 -- pm/common@45 -- $ pid=557626 00:34:55.934 01:09:02 -- pm/common@52 -- $ sudo kill -TERM 557626 00:34:55.934 + [[ -n 10167 ]] 00:34:55.934 + sudo kill 10167 00:34:55.943 [Pipeline] } 00:34:55.960 [Pipeline] // stage 00:34:55.965 [Pipeline] } 00:34:55.981 [Pipeline] // timeout 00:34:55.985 [Pipeline] } 00:34:56.000 [Pipeline] // catchError 00:34:56.005 [Pipeline] } 00:34:56.021 [Pipeline] // wrap 00:34:56.026 [Pipeline] } 00:34:56.040 [Pipeline] // catchError 00:34:56.048 [Pipeline] stage 00:34:56.050 [Pipeline] { (Epilogue) 00:34:56.063 [Pipeline] catchError 00:34:56.064 [Pipeline] { 00:34:56.077 [Pipeline] echo 00:34:56.079 Cleanup processes 00:34:56.084 [Pipeline] sh 00:34:56.371 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:56.371 557725 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:34:56.371 558074 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:56.383 [Pipeline] sh 00:34:56.665 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:34:56.665 ++ grep -v 'sudo pgrep' 00:34:56.665 ++ awk '{print $1}' 00:34:56.665 + sudo kill -9 557725 00:34:56.677 [Pipeline] sh 00:34:56.963 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:35:05.092 [Pipeline] sh 00:35:05.376 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:35:05.376 Artifacts sizes are good 00:35:05.392 [Pipeline] archiveArtifacts 00:35:05.399 Archiving artifacts 00:35:06.007 [Pipeline] sh 00:35:06.289 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:35:06.304 [Pipeline] cleanWs 00:35:06.314 [WS-CLEANUP] Deleting project workspace... 00:35:06.315 [WS-CLEANUP] Deferred wipeout is used... 00:35:06.320 [WS-CLEANUP] done 00:35:06.322 [Pipeline] } 00:35:06.341 [Pipeline] // catchError 00:35:06.352 [Pipeline] sh 00:35:06.633 + logger -p user.info -t JENKINS-CI 00:35:06.642 [Pipeline] } 00:35:06.657 [Pipeline] // stage 00:35:06.661 [Pipeline] } 00:35:06.678 [Pipeline] // node 00:35:06.683 [Pipeline] End of Pipeline 00:35:06.727 Finished: SUCCESS